Skip to content

trace

diapason.evals.core.trace

Trace data model for agentic eval runs.

QueryTrace dataclass

Per-query aggregate telemetry.

avg_cpu_power_watts property

Mean CPU power across turns; falls back to query-level power.

avg_gpu_power_watts property

Mean GPU power across turns; falls back to query-level power.

energy_per_token_joules property

GPU energy per output token; None if no energy data or zero tokens.

throughput_tokens_per_sec property

Output tokens per second; None if zero tokens or zero time.

total_tokens property

Total tokens (input + output) across all turns.

load_jsonl(path) classmethod

Load traces from a JSONL file.

save_jsonl(path)

Append this trace as a JSONL line.

to_hf_dataset(traces) staticmethod

Convert a list of QueryTrace objects to a HuggingFace Dataset.

Returns:

Type Description
Any

A datasets.Dataset with one row per trace.

TurnTrace dataclass

Per-turn telemetry data.