simpleqa diapason.evals.datasets.simpleqa ¶ SimpleQA dataset provider (basicv8vc/SimpleQA). Short-answer factual QA benchmark for evaluating factual accuracy. SimpleQADataset ¶ Bases: DatasetProvider SimpleQA short-answer factual QA benchmark.