table_gen
diapason.evals.comparison.table_gen
¶
LaTeX table generator for the framework-comparison harness.
Reads summary.json files produced by EvalRunner, builds a long-format
polars DataFrame, then renders 7 tables (T1..T7) as both tabular
fragments (paste-into-paper) and \documentclass{standalone} previews
(latexmk-renderable).
MixedCommitError
¶
Bases: TableGenError
Raised when one (framework, model, benchmark) cell has multiple commits.
NoResultsError
¶
Bases: TableGenError
Raised when no valid summary files were loaded.
ResultsFrame
dataclass
¶
Long-format DataFrame of all loaded summary.json results.
TableGenError
¶
Bases: Exception
Base for table-generation problems.
load_results(glob_pattern)
¶
Glob summary.json files, validate, return long-format ResultsFrame.
main(results_glob, tables, output_dir)
¶
Build LaTeX tables from framework-comparison evaluation results.