trolley-bench/results/contrastive-lm/blog-romeo-clm-raw.json at fm/trolley-bench-repro-readme

mirror of https://github.com/hanzoai/trolley-bench.git synced 2026-11-02 13:22:03 +00:00

Files

T

Zachary Landes 247bd2614b feat: add trolley bench v1 snapshot

* Packaged the benchmark's working copy with its frozen prompts,
  runners, raw answers, analysis and built page as committed evidence
* Rewrote run-machine paths and left out share credentials, drafts and
  operator notes; PACKAGING.md lists every exclusion and change
* Fixed the models.yaml generator listing rerun models twice, and let
  the Jev runner take its key from TYPESAFE_API_KEY

2026-09-29 00:31:07 -07:00

1 line

279 B

JSON

Raw Permalink Blame History

{"model":"clm-raw","answers":{"rank":{"type":"choice","choice":"b","confidence":0.5062937058888295,"probabilities":{"a":0.19715201101096647,"b":0.6297202794166221,"c":0.1709518053796478,"d":0.0021759041927636087}}},"usage":{"billing_units":1,"input_tokens":33,"output_tokens":0}}

1 line 279 B JSON Raw Permalink Blame History

1 line

279 B

JSON

Raw Permalink Blame History