A customer-facing assistant is tested only with polite ordinary questions. What additional evaluation is needed before release?

Published
  1. Only increase the number of ordinary greetings in the test set.
  2. Assume a commercial model cannot be influenced by malicious input.
  3. Disable all logging to ensure attacks leave no sensitive records.
  4. Run authorized adversarial tests for direct and indirect prompt attacks, data leakage, and unsafe tool use.

Comments — 0