Skip to content

gpqa

diapason.evals.datasets.gpqa

GPQA dataset provider (Idavidrein/gpqa).

Adapted from IPW's gpqa.py dataset loader.

GPQADataset

Bases: DatasetProvider

GPQA (Graduate-Level Google-Proof Q&A) multiple-choice benchmark.