This website uses cookies to ensure you get the best experience.
Learn more.
A model evaluator uses a rubric to compare two chatbots. Which design reduces position bias in an LLM judge?
Published
- Randomize answer order and check whether swapping positions changes judgments.
- Tell the judge which candidate the project manager prefers.
- Replace the rubric with the candidates' brand names.
- Always put the preferred candidate first.
Comments — 0
Sign in to comment