A Spark stage spills heavily and spends substantial time on disk. Which diagnosis is appropriate?

Published
  1. Examine memory pressure, data volume, partitioning, joins, and execution plan
  2. Add nodes without inspecting the bottleneck
  3. Rename the job
  4. Remove every log

Comments — 0