A model performs well on development questions but fails when users submit spelling errors and abbreviations. What experiment should the team add?

Published
  1. A rule to delete all failing examples before scoring.
  2. A benchmark of unrelated image resolution settings.
  3. An evaluation containing only exact copies of training prompts.
  4. A realistic robustness evaluation containing representative noisy user inputs.

Comments — 0