A team needs to compare generated answers with semantically similar reference answers rather than require identical wording. Which approach is most appropriate?

Published
  1. Use inference latency as the accuracy score
  2. Require exact byte equality for every valid answer
  3. Evaluate semantic agreement alongside factual support and task-specific checks
  4. Accept every answer with a high token count

Comments — 0