trace
diapason.evals.core.trace
¶
Trace data model for agentic eval runs.
QueryTrace
dataclass
¶
Per-query aggregate telemetry.
avg_cpu_power_watts
property
¶
Mean CPU power across turns; falls back to query-level power.
avg_gpu_power_watts
property
¶
Mean GPU power across turns; falls back to query-level power.
energy_per_token_joules
property
¶
GPU energy per output token; None if no energy data or zero tokens.
throughput_tokens_per_sec
property
¶
Output tokens per second; None if zero tokens or zero time.
total_tokens
property
¶
Total tokens (input + output) across all turns.
load_jsonl(path)
classmethod
¶
Load traces from a JSONL file.
save_jsonl(path)
¶
Append this trace as a JSONL line.
to_hf_dataset(traces)
staticmethod
¶
Convert a list of QueryTrace objects to a HuggingFace Dataset.
Returns:
| Type | Description |
|---|---|
Any
|
A datasets.Dataset with one row per trace. |
TurnTrace
dataclass
¶
Per-turn telemetry data.