Skip to content

gaia_exact

diapason.evals.scorers.gaia_exact

GAIA scorer — normalized exact match with LLM fallback.

Adapted from IPW's gaia.py evaluation handler.

GAIAScorer

Bases: LLMJudgeScorer

GAIA evaluation: exact match with normalization + LLM fallback.

exact_match(model_answer, ground_truth)

GAIA exact-match scorer with normalization for numbers, lists, and strings.