Skip to content

wrapper

diapason.telemetry.wrapper

Instrumented wrappers for inference engines — timing and telemetry publishing.

instrumented_generate(engine, messages, *, model, bus, temperature=0.7, max_tokens=1024, **kwargs)

Call engine.generate() and publish telemetry events on bus.

Returns the raw result dict from the engine.