Skip to content

frames_judge

diapason.evals.scorers.frames_judge

FRAMES scorer — LLM-as-judge for multi-hop factual retrieval.

Adapted from IPW's frames.py evaluation handler.

FRAMESScorer

Bases: LLMJudgeScorer

LLM-as-judge evaluation for FRAMES multi-hop factual retrieval.