This website uses cookies to ensure you get the best experience.
Learn more.
A team repeatedly adjusts its prompt using test-set errors, then reports the final test score as unbiased. What is the best correction?
Published
- Tune on a development set and reserve a separate untouched final test set.
- Report only the highest score observed across all attempts.
- Rename the reused test set to untouched without changing the workflow.
- Train directly on all final test answers.
Comments — 0
Sign in to comment