A model evaluator uses a rubric to compare two chatbots. Which design reduces position bias in an LLM judge?

Published
  1. Randomize answer order and check whether swapping positions changes judgments.
  2. Tell the judge which candidate the project manager prefers.
  3. Replace the rubric with the candidates' brand names.
  4. Always put the preferred candidate first.

Comments — 0