This website uses cookies to ensure you get the best experience.
Learn more.
A team compares two retrieval configurations in production. What makes the comparison more trustworthy?
Published
- Comparable traffic assignment, defined metrics, and controls for relevant differences
- Route easy users to one variant and difficult users to the other without adjustment
- Judge only whichever variant had more total requests
- Change the model and prompt unpredictably in only one variant
Comments — 0
Sign in to comment