wrapper
diapason.telemetry.wrapper
¶
Instrumented wrappers for inference engines — timing and telemetry publishing.
instrumented_generate(engine, messages, *, model, bus, temperature=0.7, max_tokens=1024, **kwargs)
¶
Call engine.generate() and publish telemetry events on bus.
Returns the raw result dict from the engine.