This website uses cookies to ensure you get the best experience.
Learn more.
A team repeatedly tunes against the same holdout until the score looks excellent. What is the main evaluation concern?
Published
- A holdout becomes larger every time it is scored
- The holdout has become part of model selection and is no longer an untouched final test
- The model registry automatically prevents evaluation leakage
- Every improved score proves better future performance
Comments — 0
Sign in to comment