Skip to content

throughput

diapason.bench.throughput

Throughput benchmark — measures tokens per second with per-sample stats.

ThroughputBenchmark

Bases: BaseBenchmark

Measures inference throughput in tokens per second.

ensure_registered()

Register the throughput benchmark if not already present.