Skip to content

Index

diapason.learning.training

Training data extraction and fine-tuning pipelines for trace-driven learning.

LoRATrainer

Fine-tune a local causal LM with LoRA (or QLoRA) adapters.

Parameters

config: LoRA training configuration. model_name: HuggingFace model identifier or local path. device: PyTorch device string. None auto-detects (cuda > mps > cpu).

Raises

ImportError If torch is not installed.

prepare_dataset(pairs)

Convert SFT pairs to tokenized examples.

Each returned dict contains input_ids, attention_mask, and text (the raw formatted string before tokenization).

Parameters

pairs: List of dicts with at least input and output keys, as produced by :class:TrainingDataMiner.extract_sft_pairs.

train(pairs)

Run LoRA fine-tuning on the given SFT pairs.

Parameters

pairs: List of dicts with at least input and output keys.

Returns

dict Training summary with keys: status, epochs, total_steps, avg_loss, adapter_path, training_samples.

LoRATrainingConfig dataclass

Configuration for LoRA / QLoRA fine-tuning.

TrainingDataMiner

Extract supervised training pairs from stored traces.

Parameters

trace_store: Any object with a list_traces(limit=...) method returning List[Trace] (typically a :class:TraceStore). min_quality: Minimum feedback score for a trace to be included. min_samples_per_class: Minimum number of samples a query class must have to appear in routing/agent-config results.

extract_agent_config_pairs(*, agent=None)

Return per-query-class agent and tool recommendations.

Returns a dict mapping query class to:

  • best_agent — agent with the highest average feedback.
  • best_tools — most frequently used tools by the best agent.
  • avg_feedback — average feedback across all agents for the class.
  • sample_count — total number of qualifying traces in the class.

extract_routing_pairs(*, agent=None)

Return per-query-class routing recommendations.

Returns a dict mapping query class to:

  • best_model — model with highest average feedback for the class.
  • avg_feedback — average feedback across all models for the class.
  • sample_count — total number of qualifying traces in the class.
  • all_models — dict of {model: {"avg_feedback": float, "count": int}}.

extract_sft_pairs(*, agent=None)

Return SFT training pairs from high-quality traces.

Each entry is a dict with keys: input, output, query_class, model, feedback.

Duplicate (input, output) pairs are collapsed; the first occurrence is kept.