This website uses cookies to ensure you get the best experience.
Learn more.
A team prepares examples for model customization. The evaluation set contains near-duplicates of training examples. Why should this be corrected?
Published
- The evaluation can overestimate generalization; separate duplicate groups across splits.
- Only the number of evaluation tokens matters, regardless of overlap.
- The model must be deployed before any split review can occur.
- Duplicates guarantee the evaluation is more independent.
Comments — 0
Sign in to comment