Skip to content

latency

diapason.bench.latency

Latency benchmark — measures per-call inference latency.

LatencyBenchmark

Bases: BaseBenchmark

Measures per-call inference latency with short prompts.

ensure_registered()

Register the latency benchmark if not already present.