Evaluator Integrity

Research

Papers & research.

Preprint

Commit-first LLM judging inherits the judge's own errors

Asking a judge to solve a task first can help—but its own mistakes can still undermine the score.

Read the paper ↗