A data scientist computes Spark DataFrame summary statistics before training. What is the main purpose?

Published
  1. Prove that every record is free of leakage
  2. Replace the need for a separate evaluation dataset
  3. Automatically select the best possible predictive algorithm
  4. Identify distribution, missingness, and scale issues worth investigating

Comments — 0