The team finds near-identical documents repeated in both training and test corpora. What should it do before trusting the test score?

Published
  1. Change only the chart colors used for reporting.
  2. Treat every duplicate as proof of broader coverage.
  3. Increase the number of duplicate test copies.
  4. Deduplicate across split boundaries and rebuild an independent evaluation set.

Comments — 0