Skip to content

eval_orchestrator

diapason.agents.hybrid.skillorchestra.prompts.eval_orchestrator

Eval orchestrator prompts for skill-based agent orchestration.

build_skill_orchestrator_prompt(problem, context_str, strategy='router_decides', handbook=None, search_skills=None, reasoning_skills=None, answer_skills=None, search_model_performance=None, reasoning_model_performance=None, answer_model_performance=None, baseline_tool_info=None)

Build enhanced orchestrator prompt with skill catalog and model performance.

Parameters:

Name Type Description Default
problem str

The question/problem to solve

required
context_str str

Current context (documents, code results, etc.)

required
strategy str

Routing strategy - "router_decides" or "analyze_model_decide" etc.

'router_decides'
handbook Any

SkillHandbook object with format_skills(stage/mode) and format_model_performance(stage/mode)

None
search_skills Optional[str]

Override - skill definitions for search stage

None
reasoning_skills Optional[str]

Override - skill definitions for reasoning stage

None
answer_skills Optional[str]

Override - skill definitions for answer stage

None
search_model_performance Optional[str]

Override - model performance for search

None
reasoning_model_performance Optional[str]

Override - model performance for reasoning

None
answer_model_performance Optional[str]

Override - model performance for answer

None
baseline_tool_info Optional[str]

Override - baseline tool descriptions

None

Returns:

Type Description
str

Formatted prompt string

format_baseline_tool_info()

Format baseline tool information for the orchestrator prompt.