This website uses cookies to ensure you get the best experience.
Learn more.
A team needs to compare generated answers with semantically similar reference answers rather than require identical wording. Which approach is most appropriate?
Published
- Use inference latency as the accuracy score
- Require exact byte equality for every valid answer
- Evaluate semantic agreement alongside factual support and task-specific checks
- Accept every answer with a high token count
Comments — 0
Sign in to comment