Skip to content

simpleqa

diapason.evals.datasets.simpleqa

SimpleQA dataset provider (basicv8vc/SimpleQA).

Short-answer factual QA benchmark for evaluating factual accuracy.

SimpleQADataset

Bases: DatasetProvider

SimpleQA short-answer factual QA benchmark.