A streaming job spends substantial time processing thousands of tiny files. Which action best addresses the data-layout concern?

Published
  1. Disable every checkpoint
  2. Remove all partition columns without analyzing access patterns
  3. Assess ingestion batching and appropriate file compaction
  4. Increase the number of tiny files further

Comments — 0