Skip to content

mmlu_pro

diapason.evals.datasets.mmlu_pro

MMLU-Pro dataset provider (TIGER-Lab/MMLU-Pro).

Adapted from IPW's mmlu_pro.py dataset loader.

MMLUProDataset

Bases: DatasetProvider

MMLU-Pro multiple-choice benchmark dataset.