A PySpark input has several versions per AccountID. The latest UpdatedAt wins, with Sequence as a deterministic tie-breaker. Which design elements are needed? Select 2 answers.

Published
  1. Use dropDuplicates on AccountID without ordering
  2. Partition a ranking window by AccountID
  3. Apply limit(1) to the whole input
  4. Order by UpdatedAt DESC and Sequence DESC, then retain row_number 1

Comments — 0