Skip to content

scorer

diapason.evals.core.scorer

Abstract base classes for scoring.

LLMJudgeScorer

Bases: Scorer

Base for scorers that need an LLM to judge answers.

Scorer

Bases: ABC

Base class for all scorers.

score(record, model_answer) abstractmethod

Score a model answer against the reference.

Returns (is_correct, metadata) where is_correct may be None if scoring could not be determined.