Skip to content

agentic_runner

diapason.evals.core.agentic_runner

AgenticRunner — multi-turn agent execution with energy telemetry correlation.

Orchestrates agentic workloads where a single query may involve multiple LLM turns and tool calls, capturing per-turn traces with energy attribution.

AgenticRunner

Orchestrate multi-turn agent runs with energy telemetry correlation.

Designed for agentic workloads where a single query may involve multiple LLM turns and tool calls. Captures per-turn TurnTrace objects with energy attribution and builds QueryTrace aggregates.

traces property

Return collected traces.

run(max_queries=None) async

Run the agent over the dataset, collecting traces and telemetry.

Parameters:

Name Type Description Default
max_queries Optional[int]

Maximum number of queries to process. None means all.

None

Returns:

Type Description
list[QueryTrace]

List of QueryTrace objects with energy-correlated telemetry.