A prompt release improves the overall score but causes a large regression for non-English support requests. Which release decision is most appropriate?

Published
  1. Remove all non-English cases from the test set.
  2. Apply cohort-specific acceptance gates and investigate the regression before broad release.
  3. Increase the model display-name version without retesting.
  4. Release solely because the English-dominated average increased.

Comments — 0