mirror of
https://github.com/hanzoai/papers.git
synced 2026-10-30 14:58:42 +00:00
5 lines
780 B
Plaintext
5 lines
780 B
Plaintext
laya-init n 200 | passage states moved by a query swap 0.3435 | global-layer attention passage->query 0.0537 | attention on token 0 0.065 | mean cos between contexts 0.853 | probe acc 0.590
|
|
rag-only@229 n 200 | passage states moved by a query swap 0.7338 | global-layer attention passage->query 0.0819 | attention on token 0 0.063 | mean cos between contexts 0.776 | probe acc 0.525
|
|
stage-a n 200 | passage states moved by a query swap 0.0849 | global-layer attention passage->query 0.1519 | attention on token 0 0.049 | mean cos between contexts 0.981 | probe acc 0.510
|
|
h2run n 200 | passage states moved by a query swap 0.9725 | global-layer attention passage->query 0.0898 | attention on token 0 0.054 | mean cos between contexts 0.644 | probe acc 0.555
|