zeekay f28120f1e0 benchmarks: RouterBench-methodology cost-quality replication pipeline ...

Declarative suite registry (suites.yaml, 12 verified HF dataset ids),
build_profiles.py to convert per-example/per-model records into router rows,
replicate.py for the cost-quality frontier + AIQ metric with individual/random/
oracle baselines, prices.yaml fallback, and bench-data/bench-replicate Make
targets. Validated on a 200-sample RouterBench slice; row-conversion + metric
tests in tests/test_benchmarks.py.

2026-07-07 17:20:55 -07:00

..

test_benchmarks.py

benchmarks: RouterBench-methodology cost-quality replication pipeline

2026-07-07 17:20:55 -07:00

test_build_dataset.py

zen-router: tiny trainable routing model

2026-07-07 15:13:57 -07:00