A team adds workers to a job that is bottlenecked on driver-side collection of the entire dataset. What should it change first?

Published
  1. Increase only the catalog description length
  2. Keep collecting all data and add workers indefinitely
  3. Remove or redesign the driver bottleneck using appropriate distributed processing
  4. Rename the output table

Comments — 0