Skip to content

ipw_mixed

diapason.evals.scorers.ipw_mixed

IPW mixed scorer -- LLM-as-judge for mixed-source evaluation datasets.

Since IPW records can originate from different source datasets, this scorer uses a general semantic comparison approach via an LLM judge (similar to the FRAMES scorer).

IPWMixedScorer

Bases: LLMJudgeScorer

LLM-as-judge evaluation for mixed-source IPW datasets.