This website uses cookies to ensure you get the best experience.
Learn more.
A streaming job spends substantial time processing thousands of tiny files. Which action best addresses the data-layout concern?
Published
- Disable every checkpoint
- Remove all partition columns without analyzing access patterns
- Assess ingestion batching and appropriate file compaction
- Increase the number of tiny files further
Comments — 0
Sign in to comment