hanzoai/papers
2
0
Fork 0
mirror of https://github.com/hanzoai/papers.git synced 2026-10-22 17:20:17 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Kai: native parity filled from the committed report, 21 states and 108/108 labels

Browse Source 
The parity report lists its checkpoints as objects now, so the generator counts
them instead of printing the list.

Co-authored-by: Hanzo Dev <[email protected]>
This commit is contained in:
zeekay
2026-09-25 20:56:20 -07:00
co-authored by Hanzo Dev
parent f997ffaf84
commit 339819c169
2 changed files with 8 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
kai/results-data.tex
+6 -1
View File
@@ -3073,7 +3073,12 @@
\setres{td/agent/qt/choice}{0.733}
\setres{td/agent/qt/noul}{0.857}
\setres{td/agent/qt/score}{0.723}
% absent: $BENCH/decision/results/laya/parity.json
\setres{par/states}{21}
\setres{par/checkpoints}{3}
\setres{par/labels}{108/108}
\setres{par/logit}{$2.9 \times 10^{-5}$}
\setres{par/prob}{$6.2 \times 10^{-6}$}
\setres{par/bound}{$1.0 \times 10^{-4}$}
\setres{cap/cardinality/jev/k1000.accall}{0.000}
\setres{cap/cardinality/jev/k1000.recall1}{0.000}
\setres{cap/cardinality/jev/k1000.recall20}{0.000}
kai/scripts/results.py
+2 -1
View File
@@ -232,7 +232,8 @@ def parity(runs):
if r is None:
return
put("par/states", r["states"])
put("par/checkpoints", r["checkpoints"])
c = r["checkpoints"]
put("par/checkpoints", len(c) if isinstance(c, list) else c)
put("par/labels", "%d/%d" % (r["labels_equal"], r["labels"]))
for f in ("max_logit", "max_prob", "bound"):
put("par/" + f.replace("max_", ""), sci(r[f]))