Skip to content

coding_task

diapason.evals.scorers.coding_task

Coding task scorer — test pass rate + structural validation.

Extracts the function/class from model output and runs test cases to determine correctness.

CodingTaskScorer

Bases: Scorer

Score coding tasks by running test cases against model output.