This website uses cookies to ensure you get the best experience.
Learn more.
A team compares two models for answering customer-service questions. Answers can be phrased differently while still being correct. Which evaluation practices provide stronger evidence than comparing one attractive demo response? Select 2 answers.
Published
- Pick whichever model produces the longest response to one easy question.
- Include qualified human review for nuanced or high-impact judgments and track disagreement or error patterns.
- Use different test questions and different quality criteria for each model, then compare only their totals.
- Evaluate only whether the endpoint returns HTTP 200.
- Use a representative held-out question set and a consistent rubric for correctness, completeness, and policy compliance.
Comments — 0
Sign in to comment