Skip to content

email_triage

email_triage

Email triage scorer — classification accuracy + draft quality.

Scores urgency and category via exact match, with LLM fallback for draft reply quality assessment.

Classes

EmailTriageScorer 

EmailTriageScorer(
    judge_backend: InferenceBackend, judge_model: str
)

Bases: LLMJudgeScorer

Score email triage: classification accuracy + draft quality.

Source code in src/diapason/evals/core/scorer.py 
33
34
35
def __init__(self, judge_backend: InferenceBackend, judge_model: str) -> None:
    self._judge_backend = judge_backend
    self._judge_model = judge_model