coding_task diapason.evals.scorers.coding_task ¶ Coding task scorer — test pass rate + structural validation. Extracts the function/class from model output and runs test cases to determine correctness. CodingTaskScorer ¶ Bases: Scorer Score coding tasks by running test cases against model output.