Records from the same customer appear in both training and validation sets, inflating performance on customer-specific signals. What split should be evaluated?

Published
  1. Sorting rows by predicted probability before splitting
  2. A group-aware split keeping each customer in one side
  3. A random row split with more shuffling
  4. Duplicating rare customers into both partitions

Comments — 0