Skip to content

ipw_mixed

diapason.evals.datasets.ipw_mixed

IPW mixed dataset provider.

Loads evaluation data from a local directory containing HuggingFace Arrow datasets or JSONL files. Does not download from HuggingFace — the data must be present on disk (e.g. bundled from the IPW repository).

IPWDataset

Bases: DatasetProvider

IPW mixed evaluation dataset loaded from a local directory.