Skip to content

table_gen

diapason.evals.comparison.table_gen

LaTeX table generator for the framework-comparison harness.

Reads summary.json files produced by EvalRunner, builds a long-format polars DataFrame, then renders 7 tables (T1..T7) as both tabular fragments (paste-into-paper) and \documentclass{standalone} previews (latexmk-renderable).

MixedCommitError

Bases: TableGenError

Raised when one (framework, model, benchmark) cell has multiple commits.

NoResultsError

Bases: TableGenError

Raised when no valid summary files were loaded.

ResultsFrame dataclass

Long-format DataFrame of all loaded summary.json results.

TableGenError

Bases: Exception

Base for table-generation problems.

load_results(glob_pattern)

Glob summary.json files, validate, return long-format ResultsFrame.

main(results_glob, tables, output_dir)

Build LaTeX tables from framework-comparison evaluation results.