mmlu_pro diapason.evals.datasets.mmlu_pro ¶ MMLU-Pro dataset provider (TIGER-Lab/MMLU-Pro). Adapted from IPW's mmlu_pro.py dataset loader. MMLUProDataset ¶ Bases: DatasetProvider MMLU-Pro multiple-choice benchmark dataset.