agentic_runner
diapason.evals.core.agentic_runner
¶
AgenticRunner — multi-turn agent execution with energy telemetry correlation.
Orchestrates agentic workloads where a single query may involve multiple LLM turns and tool calls, capturing per-turn traces with energy attribution.
AgenticRunner
¶
Orchestrate multi-turn agent runs with energy telemetry correlation.
Designed for agentic workloads where a single query may involve multiple
LLM turns and tool calls. Captures per-turn TurnTrace objects with
energy attribution and builds QueryTrace aggregates.
traces
property
¶
Return collected traces.
run(max_queries=None)
async
¶
Run the agent over the dataset, collecting traces and telemetry.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
max_queries
|
Optional[int]
|
Maximum number of queries to process. None means all. |
None
|
Returns:
| Type | Description |
|---|---|
list[QueryTrace]
|
List of |