A foreachBatch function writes to an external service and a failed microbatch is retried. What design is essential?

Published
  1. Delete the checkpoint after each successful microbatch
  2. Assume the callback executes exactly once by definition
  3. Generate a new business key for every retry
  4. Make writes idempotent using a stable batch or event identity

Comments — 0