A release candidate answers normal questions well but leaks protected facts when given adversarial instructions. What should happen before production rollout?

Published
  1. Delete the failing test cases
  2. Release solely because its normal-question average is high
  3. Increase output length to make the leak harder to notice
  4. Include adversarial safety and access-control evaluation and fix the failure

Comments — 0