make_configs
diapason.evals.comparison.make_configs
¶
CLI for generating framework-comparison eval configs from _template.toml.
Usage
python -m diapason.evals.comparison.make_configs \ --framework hermes --model qwen-9b --benchmark gaia