This website uses cookies to ensure you get the best experience.
Learn more.
Analysts query a large S3 dataset in Athena, usually filtering by event date and selecting only a few columns. The data is stored as unpartitioned CSV. Which redesign most directly reduces unnecessary scanning?
Published
- Store compressed Parquet and partition by a useful event-date granularity aligned with query filters.
- Create one partition for every unique row identifier even though queries do not filter by that identifier.
- Compress the entire CSV dataset into one large non-splittable object without any date partitioning.
- Add LIMIT 10 to every query and assume Athena will read only ten source rows for all query shapes.
Comments — 0
Sign in to comment