Skip to content

chat_latency

diapason.telemetry.chat_latency

Request-local chat timings; never infer queue time from generation time.

ChatLatency

Measurements for one response, including its hidden generation passes.