taubench
diapason.evals.datasets.taubench
¶
TauBench V2 dataset provider — multi-turn customer service benchmark.
Wraps the tau2-bench framework for evaluation within Diapason. Supports airline, retail, and telecom domains.
Reference: https://github.com/sierra-research/tau2-bench
TauBenchDataset
¶
Bases: DatasetProvider
TauBench V2 multi-turn customer service benchmark.
Wraps tau2-bench's task loading and evaluation infrastructure. Each EvalRecord represents a single customer service scenario.