A source may send the same transaction in several different files. Why is file-level ingestion tracking insufficient?

Published
  1. Delta cannot store duplicate values
  2. Different files can contain duplicate business records
  3. Checkpointing deletes duplicate source business transactions
  4. File tracking guarantees all rows have unique primary keys

Comments — 0