Skip to content

itl

diapason.telemetry.itl

Inter-token latency percentile computation.

compute_itl_stats(token_timestamps)

Compute ITL statistics from token arrival timestamps (in ms).

Returns dict with p50_ms, p90_ms, p95_ms, p99_ms, mean_ms, min_ms, max_ms.