Skip to content

coding_task

diapason.evals.datasets.coding_task

Coding task benchmark dataset.

Standalone function-level coding problems with test cases for evaluating code generation accuracy.

CodingTaskDataset

Bases: DatasetProvider

Coding task benchmark: function-level code generation with test cases.