This website uses cookies to ensure you get the best experience.
Learn more.
A PySpark input has several versions per AccountID. The latest UpdatedAt wins, with Sequence as a deterministic tie-breaker. Which design elements are needed? Select 2 answers.
Published
- Use dropDuplicates on AccountID without ordering
- Partition a ranking window by AccountID
- Apply limit(1) to the whole input
- Order by UpdatedAt DESC and Sequence DESC, then retain row_number 1
Comments — 0
Sign in to comment