Skip to content

knowledge_base

diapason.evals.scorers.knowledge_base

Knowledge base scorer — answer correctness via normalized match + LLM fallback.

Evaluates document-grounded QA by checking if the model answer matches the reference answer using exact match with normalization, falling back to LLM judge for semantic comparison.

KnowledgeBaseScorer

Bases: LLMJudgeScorer

Score knowledge base QA: answer correctness.