Skip to content

paperarena_judge

diapason.evals.scorers.paperarena_judge

Scorer for PaperArena: MC exact match + LLM judge for CA/OA.

PaperArenaScorer

Bases: LLMJudgeScorer

Score PaperArena: MC via letter extraction, CA/OA via LLM judge.