Skip to content

gpqa_mcq

diapason.evals.scorers.gpqa_mcq

GPQA MCQ scorer — LLM-based letter extraction + exact match.

Adapted from IPW's mcq.py and gpqa.py evaluation handlers.

GPQAScorer

Bases: LLMJudgeScorer

Score GPQA responses by extracting answer letter via LLM.