mirror of
https://github.com/hanzoai/site.git
synced 2026-11-21 01:07:08 +00:00
platform.hanzo.ai is the platform console (with cloud.hanzo.ai redirecting to it at the edge). Point the remaining cloud.hanzo.ai links on /benchmarks and /philosophy directly at https://platform.hanzo.ai. Claude-Session: https://claude.ai/code/session_015XYKLix9PSyn6Jw2HWKprk
1 line
42 KiB
HTML
1 line
42 KiB
HTML
<div class="is_View _col-_platformweb_text-primar121 _fd-column _dsp-block _minH-100vh _bg-background"><main class="is_View _col-_platformweb_text-primar121 _fd-column _maxW-1080px _width-10037 _mr-auto _ml-auto _pt-64px _pr-24px _pl-24px _pb-96px _bg-background"><p class="is_Text _col-muted-foreg108704142 _dsp-block _mb-4px _fs-f-size-1 _lh-f-lineHeigh112922" data-slot="text"><a href="/benchmarks">Benchmarks</a> / <!-- -->GPQA-Diamond</p><span class="is_Text _col-muted-foreg108704142 _dsp-block _fs-f-size-1 _lh-f-lineHeigh112922 _ls-0--88px _tt-uppercase" data-slot="text">measured</span><h1 class="is_Text font_heading _fs-_sm_f-size-11 _fs-_lg_text-6xl _textWrap-_platformweb_balance _col-foreground _dsp-revert-laye114 _ws-inherit _ff-f-family _fs-f-size-10 _fw-497 _lh-1--19 _ls--0--012em _textWrap-balance _mt-8px _mb-16px" data-slot="display">The router on GPQA-Diamond</h1><p class="is_Text _col-muted-foreg108704142 _dsp-revert-laye114 _ws-inherit _fs-f-size-3 _lh-1--65 _ls-0px _textWrap-pretty _maxW-720px" data-slot="lede">One set of 198 graduate-level questions, answered by Enso's router and by single models from other labs, every row a research run.</p><dl class="is_Text _col-text-primar121 _dsp-grid _gridTemplateColumns-minmax120px329255122 _rowGap-8px _columnGap-20px _mt-20px _mr-0px _mb-0px _ml-0px _maxW-760px _fs-f-size-2 _lh-f-lineHeigh112922" data-slot="text"><dt class="is_Text _col-muted-foreg108704142" data-slot="text">dataset</dt><dd class="is_Text _col-inherit _mt-0px _mr-0px _mb-0px _ml-0px" data-slot="text"><a href="https://huggingface.co/datasets/Idavidrein/gpqa">GPQA</a></dd><dt class="is_Text _col-muted-foreg108704142" data-slot="text">licence</dt><dd class="is_Text _col-inherit _mt-0px _mr-0px _mb-0px _ml-0px" data-slot="text">CC BY 4.0</dd><dt class="is_Text _col-muted-foreg108704142" data-slot="text">introduced by</dt><dd class="is_Text _col-inherit _mt-0px _mr-0px _mb-0px _ml-0px" data-slot="text"><a href="https://arxiv.org/abs/2311.12022">GPQA: A Graduate-Level Google-Proof Q&A Benchmark</a> — <!-- -->Rein, Hou, Stickland, Petty, Pang, Dirani, Michael, Bowman<!-- -->, <!-- -->COLM 2024</dd><dt class="is_Text _col-muted-foreg108704142" data-slot="text">harness</dt><dd class="is_Text _col-inherit _mt-0px _mr-0px _mb-0px _ml-0px" data-slot="text"><a href="https://api.hanzo.ai/v1/research/runs?org=hanzo&benchmark=enso.gpqa_diamond">api.hanzo.ai/v1/research</a></dd></dl><code class="is_Text font_mono _col-text-primar121 _dsp-block _mt-10px _pt-10px _pb-10px _pr-14px _pl-14px _btw-1px _brw-1px _borderBottomWidth-1px _borderLeftWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _btlr-6px _btrr-6px _bbrr-6px _bblr-6px _ox-auto _bg-card _ff-f-family _fs-f-size-1 _bbs-solid _bts-solid _bls-solid _brs-solid" data-slot="text">curl -s "https://api.hanzo.ai/v1/research/runs?org=hanzo&benchmark=enso.gpqa_diamond"</code><p class="is_Text font_mono _col-muted-foreg108704142 _dsp-block _mb-10px _ff-f-family _fs-f-size-1 _lh-f-lineHeigh112922 _mt-8px" data-slot="text">prints the table on this page — transcribed from the research API, read when the page opens</p><h2 class="is_Text font_heading _col-foreground _dsp-revert-laye114 _ws-inherit _ff-f-family _fs-f-size-7 _fw-497 _lh-1--2 _ls--0--01em _textWrap-balance _mt-56px _mb-8px" data-slot="title">What is measured</h2><p class="is_Text _col-text-second96872 _dsp-block _maxW-720px _lh-1--3563rem" data-slot="text">GPQA-Diamond is the hardest subset of GPQA: 198 multiple-choice questions in biology, physics and chemistry, written by domain PhDs and filtered to the ones that other PhDs get right and skilled non-experts get wrong even with the web open. It is a knowledge benchmark rather than an agentic one — one question, one answer, no tools — which is what makes it useful here: it isolates the choice of model from everything else a system does.</p><p class="is_Text _col-text-second96872 _dsp-block _maxW-720px _lh-1--3563rem" data-slot="text">What the router adds is that the choice is per question. Enso reads each one and dispatches it, so a tier is not a model — it is a pool and a willingness to spend. Every row below answers the same 198 questions, which is why a score and what its run cost belong in one table, and why a score quoted without its cost says nothing about the system it came from.</p><div class="is_View _fd-column" data-board="enso.gpqa_diamond"><p class="is_Text font_mono _col-muted-foreg108704142 _dsp-block _mb-10px _ff-f-family _fs-f-size-1 _lh-f-lineHeigh112922" data-slot="text">GPQA Diamond · enso.gpqa_diamond, split test · every row a research run, read from api.hanzo.ai when the page opens · sorted by accuracy</p><div class="is_View _ox-auto _btw-1px _brw-1px _borderBottomWidth-1px _borderLeftWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _btlr-6px _btrr-6px _bbrr-6px _bblr-6px _bg-card _bbs-solid _bts-solid _bls-solid _brs-solid"><table class="is_Text _dsp-_platformweb_table _borderCollapse-_platformweb_collapse _fontVariantNumeric-_platformweb_tabular-num115 _col-text-primar121 _width-10037 _fs-f-size-2 _lh-f-lineHeigh112922" data-slot="text"><thead><tr><th class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-left _pt-8px _pb-8px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _fw-500 _ws-nowrap _bbs-solid" data-slot="text">System</th><th class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-8px _pb-8px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _fw-500 _ws-nowrap _bbs-solid" data-slot="text">Accuracy</th><th class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-8px _pb-8px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _fw-500 _ws-nowrap _bbs-solid" data-slot="text">Correct</th><th class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-8px _pb-8px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _fw-500 _ws-nowrap _bbs-solid" data-slot="text">Run cost</th><th class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-left _pt-8px _pb-8px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _fw-500 _ws-nowrap _bbs-solid" data-slot="text">Tag, date</th></tr></thead><tbody><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text"><strong>enso</strong><span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-frontier-enso">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-text-primar121 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _fw-600 _bbs-solid" data-slot="text">92.9%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">184 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$5.58</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">frontier<!-- --> · <!-- -->2026-07-19</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text"><strong>enso-ultra</strong><span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-frontier-enso-ultra">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-text-primar121 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _fw-600 _bbs-solid" data-slot="text">92.9%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">184 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$20.20</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">frontier<!-- --> · <!-- -->2026-07-19</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">gpt-5.6-sol<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-frontier-gpt-5.6-sol">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">91.9%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">182 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$4.08</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">frontier<!-- --> · <!-- -->2026-07-19</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">opus-5.5<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-fill-opus-5.5">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">90.9%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">180 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$3.78</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">fill<!-- --> · <!-- -->2026-10-16</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">sonnet-5.5<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-fill-sonnet-5.5">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">90.4%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">179 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$1.85</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">fill<!-- --> · <!-- -->2026-10-16</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">gpt-5.5<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-frontier-gpt-5.5">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">89.9%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">178 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$11.95</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">frontier<!-- --> · <!-- -->2026-07-19</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">fable-5.1<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-fill-fable-5.1">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">87.9%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">174 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$8.23</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">fill<!-- --> · <!-- -->2026-10-16</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">opus-4.8<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-frontier-opus-4.8">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">86.4%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">171 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$3.66</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">frontier<!-- --> · <!-- -->2026-07-19</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">haiku-5.5<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-fill-haiku-5.5">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">83.3%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">165 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$0.190</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">fill<!-- --> · <!-- -->2026-10-16</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">fable-5<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-frontier-fable-5">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">82.8%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">164 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$9.87</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">frontier<!-- --> · <!-- -->2026-07-19</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">claude-5-sonnet<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-frontier-claude-5-sonnet">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">77.8%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">154 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$5.66</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">frontier<!-- --> · <!-- -->2026-07-19</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">deepseek-v4-pro<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-frontier-deepseek-v4-pro">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">74.2%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">147 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$0.259</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">frontier<!-- --> · <!-- -->2026-07-19</span></td></tr><tr class="is_Text _dsp-_platformweb_table-row _col-inherit" data-slot="text"><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _minW-calc10em1281 _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-normal _bbs-solid" data-slot="text">gpt-4o<span class="is_Text _overflowWrap-_platformweb_anywhere _col-muted-foreg108704142 _dsp-block _mt-2px _fs-f-size-1 _lh-f-lineHeigh112922 _fw-400" data-slot="text"><a class="is_Text _col-inherit" data-slot="text" href="https://api.hanzo.ai/v1/research/runs?org=hanzo&id=enso.gpqa_diamond-test-frontier-gpt-4o">run</a></span></td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-muted-foreg108704142 _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">54.5%</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">108 of 198</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-right _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text">$1.58</td><td class="is_Text _dsp-_platformweb_table-cell _fontVariantNumeric-_platformweb_tabular-num115 _col-inherit _text-left _pt-7px _pb-7px _pr-12px _pl-12px _borderBottomWidth-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _ws-nowrap _bbs-solid" data-slot="text"><span class="is_Text _col-muted-foreg108704142" data-slot="text">frontier<!-- --> · <!-- -->2026-07-19</span></td></tr></tbody></table></div><p class="is_Text _col-text-second96872 _dsp-block _maxW-720px _lh-1--2594rem _mt-14px _fs-f-size-2 _borderLeftWidth-2px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _pl-14px _bls-solid" data-slot="text">Each system's frontier run, else its v1 run, else its fill run: the three put the same prompts to a model. A run cost is the input and output tokens the run records at the price list's rate for its own model id, the router's included, at list prices, Nov 7, 2026; a dash is a run that records no tokens, a model the list does not price, or a list that could not be read.</p></div><h2 class="is_Text font_heading _col-foreground _dsp-revert-laye114 _ws-inherit _ff-f-family _fs-f-size-7 _fw-497 _lh-1--2 _ls--0--01em _textWrap-balance _mt-56px _mb-8px" data-slot="title">What this does not establish</h2><p class="is_Text _col-text-second96872 _dsp-block _maxW-720px _lh-1--3563rem" data-slot="text"><strong>A benchmark score is not a capability.</strong> <!-- -->GPQA-Diamond is four-way multiple choice on settled science. It measures what a pool knows and rewards a router that recognises a hard question; it says nothing about whether the answer is reasoned, whether the model holds up over a long autonomous run, or whether it can use a tool. The routing overhead is real work this table does not score either.</p><p class="is_Text _col-text-second96872 _dsp-block _maxW-720px _lh-1--3563rem" data-slot="text"><strong>A row is a run, as of its date.</strong> <!-- -->Every row went through enso-bench's harness at the tag and on the date it shows; a system is the router or a single model as that run met it, not necessarily a preset the catalog serves today. What a row cost is the tokens its run records at today's list price for its own model id, the router's included, so two rows are priced by one rule.</p><div class="is_View _fd-column _mt-48px _pt-16px"><div class="is_View _text-_platformweb_center _fd-column _mt-56px _mb-24px _pt-36px _pb-36px _pr-32px _pl-32px _btlr-12px _btrr-12px _bbrr-12px _bblr-12px _btw-1px _brw-1px _borderBottomWidth-1px _borderLeftWidth-1px _btc-border-stro3513 _brc-border-stro3513 _borderBottomColor-border-stro3513 _borderLeftColor-border-stro3513 _backgroundImage-linear-grad1889052070 _items-center _gap-16px _bbs-solid _bts-solid _bls-solid _brs-solid"><p class="is_Text font_mono _col-muted-foreg108704142 _dsp-block _mb-0px _ff-f-family _fs-f-size-1 _lh-f-lineHeigh112922 _mt-0px _mr-0px _ml-0px _ls-1--32px _tt-uppercase" data-slot="text">Hanzo AI Cloud</p><h3 class="is_Text _fs-_md_f-size-10 _lh-_md_2--5rem _col-text-primar121 _dsp-block _mt-0px _mr-0px _mb-0px _ml-0px _fs-f-size-7 _lh-1--6406rem _fw-600 _ls-f-letterSpa1360334199" data-slot="text">Build on Hanzo Cloud</h3><div class="is_View _fd-row _fwr-wrap _gap-12px _mt-8px _justify-center"><a class="is_Text _col-background _dsp-inline-flex _items-center _gap-8px _pt-12px _pb-12px _pr-24px _pl-24px _btlr-9999px _btrr-9999px _bbrr-9999px _bblr-9999px _btw-1px _brw-1px _borderBottomWidth-1px _borderLeftWidth-1px _btc-transparent _brc-transparent _borderBottomColor-transparent _borderLeftColor-transparent _bg-text-primar121 _fs-f-size-3 _lh-f-lineHeigh112922 _fw-600 _bbs-solid _bts-solid _bls-solid _brs-solid" data-slot="text" href="https://platform.hanzo.ai">Start on Hanzo Cloud<svg aria-hidden="true" data-i18n-mirror="true" fill="none" height="14" stroke="var(--background)" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" style="color:var(--background);flex-shrink:0" viewbox="0 0 24 24" width="14"><path d="M5 12h14" stroke="var(--background)"></path><path d="m12 5 7 7-7 7" stroke="var(--background)"></path></svg></a><a class="is_Text _col-text-primar121 _dsp-inline-flex _items-center _gap-8px _pt-12px _pb-12px _pr-24px _pl-24px _btlr-9999px _btrr-9999px _bbrr-9999px _bblr-9999px _btw-1px _brw-1px _borderBottomWidth-1px _borderLeftWidth-1px _btc-border-stro3513 _brc-border-stro3513 _borderBottomColor-border-stro3513 _borderLeftColor-border-stro3513 _bg-transparent _fs-f-size-3 _lh-f-lineHeigh112922 _fw-500 _bbs-solid _bts-solid _bls-solid _brs-solid" data-slot="text" href="/pricing">View Models & Pricing</a></div></div><div class="is_View _fd-column _btw-1px _btc-edge _brc-edge _borderBottomColor-edge _borderLeftColor-edge _pt-32px _bts-solid"><div class="is_View _fd-row _fwr-wrap _justify-space-betwe3241 _items-center _gap-16px _mb-32px _pt-16px _pb-16px _pr-20px _pl-20px _bg-card _btw-1px _brw-1px _borderBottomWidth-1px _borderLeftWidth-1px _btc-border _brc-border _borderBottomColor-border _borderLeftColor-border _btlr-8px _btrr-8px _bbrr-8px _bblr-8px _bbs-solid _bts-solid _bls-solid _brs-solid"><a class="is_View _fd-column _gap-2px _items-flex-start" href="/benchmarks/inference"><div class="is_View _fd-row _items-center _gap-4px"><svg aria-hidden="true" data-i18n-mirror="true" fill="none" height="12" stroke="var(--muted-foreground)" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" style="color:var(--muted-foreground);flex-shrink:0" viewbox="0 0 24 24" width="12"><path d="m12 19-7-7 7-7" stroke="var(--muted-foreground)"></path><path d="M19 12H5" stroke="var(--muted-foreground)"></path></svg><span class="is_Text _col-muted-foreg108704142 _fs-f-size-1 _lh-f-lineHeigh112922 _tt-uppercase _ls-0--44px" data-slot="text">Previous</span></div><span class="is_Text _col-text-primar121 _fs-f-size-3 _lh-f-lineHeigh112922 _fw-500" data-slot="text">Engine prefill on CUDA vs llama.cpp</span></a><a class="is_Text _col-muted-foreg108704142 _pt-6px _pb-6px _pr-12px _pl-12px _btlr-4px _btrr-4px _bbrr-4px _bblr-4px _bg-edge _btw-1px _brw-1px _borderBottomWidth-1px _borderLeftWidth-1px _btc-border _brc-border _borderBottomColor-border _borderLeftColor-border _fs-f-size-2 _lh-f-lineHeigh112922 _bbs-solid _bts-solid _bls-solid _brs-solid" data-slot="text" href="/benchmarks">All Benchmarks Board</a><a class="is_View _fd-column _gap-2px _items-flex-end" href="/benchmarks/locomo"><div class="is_View _fd-row _items-center _gap-4px"><span class="is_Text _col-muted-foreg108704142 _fs-f-size-1 _lh-f-lineHeigh112922 _tt-uppercase _ls-0--44px" data-slot="text">Next</span><svg aria-hidden="true" data-i18n-mirror="true" fill="none" height="12" stroke="var(--muted-foreground)" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" style="color:var(--muted-foreground);flex-shrink:0" viewbox="0 0 24 24" width="12"><path d="M5 12h14" stroke="var(--muted-foreground)"></path><path d="m12 5 7 7-7 7" stroke="var(--muted-foreground)"></path></svg></div><span class="is_Text _col-text-primar121 _fs-f-size-3 _lh-f-lineHeigh112922 _fw-500" data-slot="text">LoCoMo</span></a></div><div class="is_View _fd-column"><span class="is_Text font_mono _col-muted-foreg108704142 _dsp-block _mb-8px _ff-f-family _fs-f-size-2 _lh-f-lineHeigh112922 _tt-uppercase _ls-0--52px" data-slot="text">Other benchmarks</span><p class="is_Text _col-text-second96872 _dsp-block _maxW-720px _lh-1--3563rem _mt-0px _mr-0px _mb-0px _ml-0px _fs-f-size-2" data-slot="text"><span class="is_Text _col-inherit" data-slot="text"><a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/locomo">LoCoMo</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/memoryagentbench">MemoryAgentBench</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/longmemeval">LongMemEval</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/cronquestions">CronQuestions</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/repobench-r">RepoBench-R</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/locomo-subject-scope">LoCoMo · subject scope</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/locomo-conv">LoCoMo-Conv</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/fleet">Fleet residency</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/goroutine">Live agent footprint</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/sandbox">Sandbox cold start</a></span><span class="is_Text _col-inherit" data-slot="text"> · <a class="is_Text _col-text-second96872" data-slot="text" href="/benchmarks/inference">Engine prefill on CUDA vs llama.cpp</a></span></p></div></div></div><p class="is_Text font_mono _col-muted-foreg108704142 _dsp-block _mb-10px _ff-f-family _fs-f-size-1 _lh-f-lineHeigh112922" data-slot="text">every figure a research run at <a href="https://api.hanzo.ai/v1/research/runs?org=hanzo&benchmark=enso.gpqa_diamond">api.hanzo.ai</a> · the dataset: <a href="https://huggingface.co/datasets/Idavidrein/gpqa">GPQA</a> under <!-- -->CC BY 4.0</p></main><!--$--><!--/$--></div> |