mirror of
https://github.com/hanzoai/papers.git
synced 2026-10-30 14:58:42 +00:00
18 lines
2.1 KiB
Plaintext
18 lines
2.1 KiB
Plaintext
corpus: 100000 train rows, 2345 val rows, suites ["rag_relevance"] (2s)
|
||
init: 176 tensors carried, fresh: ["ordinal.cut.bias", "ordinal.cut.weight", "ordinal.gap.bias", "ordinal.gap.weight", "ordinal.location.bias", "ordinal.location.center", "ordinal.location.weight", "retrieval.key.bias", "retrieval.key.center", "retrieval.key.weight", "retrieval.query.bias", "retrieval.query.center", "retrieval.query.weight", "retrieval.scale"]
|
||
plan: stage rag3, 2 epochs, 1540 batches, 46 warmup, 308 cooldown; rows on a sample of their options, by epoch: [0, 0]
|
||
cluster: coordinating on 127.0.0.1:60353
|
||
cluster: ra (127.0.0.1:60354) joins round 0 as worker 0 (Metal { gpu_id: 4294970014 }, BF16)
|
||
worker 0 (ra): joined round 0
|
||
round 0: 149/1540 lr×1.000 eta 19m | ra 149 steps 4913 tok/s nll 0.6615 ret 0.0000 | ret 0.0000 | 121.3s, closed 1.3s past the deadline, outer step 0.1s
|
||
worker 0 round 0: 149 steps 4913 tok/s (4948 padded; contexts 4888 of 4921) nll 0.6615 ret 0.0000 gpu 98% free 67% | delta sent 0.2s, waited 0.1s, update 0.1s
|
||
round 1: 299/1540 lr×1.000 eta 17m | ra 150 steps 4903 tok/s nll 0.6402 ret 0.0000 | ret 0.0000 | 121.1s, closed 1.1s past the deadline, outer step 0.0s
|
||
worker 0 round 1: 150 steps 4903 tok/s (4939 padded; contexts 4878 of 4912) nll 0.6402 ret 0.0000 gpu 98% free 67% | delta sent 0.2s, waited 0.0s, update 0.1s, state kept
|
||
val @299: rag_relevance 0.590/0.735
|
||
saved runs/rag3 at 299 batches, 0 epochs
|
||
round 2: 443/1540 lr×1.000 eta 15m | ra 144 steps 4797 tok/s nll 0.6375 ret 0.0000 | ret 0.0000 | 121.9s, closed 1.9s past the deadline, outer step 0.2s
|
||
worker 0 round 2: 144 steps 4797 tok/s (4828 padded; contexts 4773 of 4802) nll 0.6375 ret 0.0000 gpu 98% free 60% | delta sent 0.3s, waited 0.2s, update 0.1s
|
||
round 3: 591/1540 lr×1.000 eta 13m | ra 148 steps 4944 tok/s nll 0.6445 ret 0.0000 | ret 0.0000 | 120.7s, closed 0.7s past the deadline, outer step 0.1s
|
||
worker 0 round 3: 148 steps 4944 tok/s (4982 padded; contexts 4920 of 4955) nll 0.6445 ret 0.0000 gpu 98% free 61% | delta sent 0.3s, waited 0.1s, update 0.1s, state kept
|
||
val @591: rag_relevance 0.532/0.741
|