Thousands of new JSON files arrive continuously in cloud object storage. The ingestion pipeline must discover new files incrementally rather than reload the whole directory each run. Which capability fits?

Published
  1. Auto Loader
  2. A scheduled overwrite from a full directory batch read
  3. A one-time manual browser upload as the ongoing ingestion mechanism
  4. A full table export after every file arrival

Comments — 0