A team repeatedly adjusts its prompt using test-set errors, then reports the final test score as unbiased. What is the best correction?

Published
  1. Tune on a development set and reserve a separate untouched final test set.
  2. Report only the highest score observed across all attempts.
  3. Rename the reused test set to untouched without changing the workflow.
  4. Train directly on all final test answers.

Comments — 0