papers/kai/data/diagnosis/a.log

corpus: 3686475 train rows, 139621 val rows, suites ["ag_news", "emotion", "banking77", "support_triage", "email_spam", "phishing", "guardrails_jailbreak", "moderation_toxicity", "rag_relevance", "model_routing_domain", "typed_decisions", "massive", "tool", "risk", "done", "repo", "function", "resolve", "action", "nemotron", "clinc150", "xnli", "sst5", "shuffle", "alias", "near", "subset", "swap", "codeswitch", "boolq", "mnli", "code.file.gold", "code.affected.gold", "code.symbol.gold", "code.suspect.gold", "code.test.silver", "control.context.gold", "control.user.gold", "control.continue.gold", "control.commit.gold", "control.rollback.gold", "control.strategy.gold", "control.repeat.gold", "control.done.gold", "control.retry.gold", "control.user.silver", "code.failure.gold", "code.failure.silver", "skills.select.silver", "graph_typed", "turbofan", "rig", "sysml", "readiness", "trade", "testplan", "arch"] (62s)
init: 176 tensors carried, fresh: ["ordinal.cut.bias", "ordinal.cut.weight", "ordinal.gap.bias", "ordinal.gap.weight", "ordinal.location.bias", "ordinal.location.weight", "retrieval.key.bias", "retrieval.key.weight", "retrieval.query.bias", "retrieval.query.weight", "retrieval.scale"]
plan: stage a, 1 epochs, 91899 batches, 2756 warmup, 18379 cooldown; rows on a sample of over 64 options, by epoch: [65352]
resume: round 2, 2325 of 91899 batches merged, optimizer states of ["evo", "dgx", "dbc"]
cluster: coordinating on 0.0.0.0:7070
cluster: dbc (127.0.0.1:52177) joins round 2 as worker 0 (Metal { gpu_id: 4294968649 }, BF16), optimizer state at step 1519
worker 0 (dbc): joined round 2, optimizer state at step 1519
cluster: evo (10.0.0.57:51834) joins round 2 as worker 1 (Rocm { gpu_id: 0 }, BF16), optimizer state at step 184
cluster: dgx (10.0.0.19:34202) joins round 2 as worker 2 (Cuda { gpu_id: 0 }, BF16), optimizer state at step 622
round 2: 3293/91899 lr×1.000 eta 541m | dbc 775 steps 7028 tok/s nll 2.3919 | evo 43 steps 1136 tok/s nll 2.4592 | dgx 150 steps 4175 tok/s nll 2.4464 | 329.2s, closed 29.2s past the deadline, outer step 0.1s
worker 0 round 2: 775 steps 7028 tok/s (7430 padded; contexts 4988 of 5004) nll 2.3919 gpu 88% free 81% | delta sent 0.1s, waited 28.5s, update 0.0s
round 3: 4693/91899 lr×1.000 eta 407m | dbc 771 steps 7008 tok/s nll 2.4125 | evo 171 steps 1797 tok/s nll 2.3506 | dgx 458 steps 4218 tok/s nll 2.3450 | 308.3s, closed 8.3s past the deadline, outer step 0.0s
worker 0 round 3: 771 steps 7008 tok/s (7412 padded; contexts 4968 of 4982) nll 2.4125 gpu 94% free 80% | delta sent 0.1s, waited 7.6s, update 0.0s
round 4: 6101/91899 lr×1.000 eta 367m | dbc 763 steps 7039 tok/s nll 2.3025 | evo 182 steps 1739 tok/s nll 2.4304 | dgx 463 steps 4332 tok/s nll 2.2740 | 307.0s, closed 7.0s past the deadline, outer step 0.0s
worker 0 round 4: 763 steps 7039 tok/s (7436 padded; contexts 5050 of 5067) nll 2.3025 gpu 94% free 81% | delta sent 0.1s, waited 6.3s, update 0.0s
round 5: 7504/91899 lr×1.000 eta 347m | dbc 775 steps 7033 tok/s nll 2.2869 | evo 156 steps 1587 tok/s nll 2.3398 | dgx 472 steps 4313 tok/s nll 2.1927 | 306.4s, closed 6.4s past the deadline, outer step 0.0s
worker 0 round 5: 775 steps 7033 tok/s (7418 padded; contexts 5046 of 5057) nll 2.2869 gpu 94% free 80% | delta sent 0.1s, waited 5.9s, update 0.0s
round 6: 8894/91899 lr×1.000 eta 333m | dbc 771 steps 7066 tok/s nll 2.2044 | evo 166 steps 1663 tok/s nll 2.4436 | dgx 453 steps 4237 tok/s nll 2.1281 | 306.6s, closed 6.6s past the deadline, outer step 0.0s
worker 0 round 6: 771 steps 7066 tok/s (7450 padded; contexts 5071 of 5084) nll 2.2044 gpu 95% free 80% | delta sent 0.1s, waited 6.1s, update 0.0s
round 7: 10282/91899 lr×1.000 eta 323m | dbc 761 steps 7056 tok/s nll 2.2521 | evo 158 steps 1645 tok/s nll 2.1156 | dgx 469 steps 4245 tok/s nll 2.2524 | 306.9s, closed 6.9s past the deadline, outer step 0.0s
worker 0 round 7: 761 steps 7056 tok/s (7427 padded; contexts 5091 of 5102) nll 2.2521 gpu 94% free 80% | delta sent 0.1s, waited 6.4s, update 0.0s
round 8: 11696/91899 lr×1.000 eta 313m | dbc 769 steps 7022 tok/s nll 2.1954 | evo 177 steps 1787 tok/s nll 2.2847 | dgx 468 steps 4274 tok/s nll 2.1066 | 306.9s, closed 6.9s past the deadline, outer step 0.0s
worker 0 round 8: 769 steps 7022 tok/s (7405 padded; contexts 4988 of 5001) nll 2.1954 gpu 94% free 80% | delta sent 0.1s, waited 6.7s, update 0.0s
round 9: 13101/91899 lr×1.000 eta 305m | dbc 773 steps 7060 tok/s nll 2.1973 | evo 169 steps 1772 tok/s nll 2.0504 | dgx 463 steps 4191 tok/s nll 2.1364 | 306.6s, closed 6.6s past the deadline, outer step 0.1s
worker 0 round 9: 773 steps 7060 tok/s (7465 padded; contexts 5016 of 5034) nll 2.1973 gpu 94% free 81% | delta sent 0.1s, waited 6.0s, update 0.0s, state kept
val: 1466 wide rows over 394180 options, each answered over all of them, retrieval's top 32 by the head (123s); 11988 rows by the head (310s)
val @13101: action 0.273/1.801  ag_news 0.375/1.286  arch 0.670/0.882  banking77 0.074/3.691  boolq 0.668/0.687  clinc150 0.045/4.284  code.affected.gold 0.465/0.694  code.failure.silver 0.263/1.763  code.file.gold 0.062/4.274  code.suspect.gold 0.000/4.893  code.symbol.gold 0.053/4.320  code.test.silver 0.062/3.625  control.commit.gold 0.190/0.818  control.context.gold 0.806/1.231  control.continue.gold 0.095/0.764  control.done.gold 0.909/0.638  control.repeat.gold 1.000/0.586  control.retry.gold 0.000/1.105  control.rollback.gold 0.571/0.693  control.strategy.gold 0.750/0.633  control.user.silver 0.875/0.499  done 0.983/0.540  email_spam 0.973/0.137  emotion 0.525/1.396  function 0.393/2.355  graph_typed 0.489/1.198  guardrails_jailbreak 0.502/0.682  massive 0.440/1.810  mnli 0.713/0.784  model_routing_domain 0.882/0.577  moderation_toxicity 0.857/0.302  nemotron 0.360/2.510  phishing 0.922/0.345  rag_relevance 0.482/0.704  readiness 0.438/1.176  resolve 0.003/0.735  rig 0.465/1.113  risk 0.000/2.330  skills.select.silver 0.000/7.154  sst5 0.230/1.693  support_triage 0.360/1.837  sysml 0.583/0.751  testplan 0.608/1.048  tool 0.145/2.406  trade 0.608/0.891  turbofan 0.420/1.004  typed_decisions 0.503/1.153  xnli 0.698/0.842
saved /Users/a/scratch/decision/runs/a at 13101 batches, 0 epochs
round 10: 14246/91899 lr×1.000 eta 319m | dbc 528 steps 4719 tok/s nll 2.1669 | evo 165 steps 1652 tok/s nll 2.0316 | dgx 452 steps 4212 tok/s nll 2.1329 | 436.2s, closed 136.2s past the deadline, outer step 0.0s
worker 0 round 10: 528 steps 4719 tok/s (4969 padded; contexts 3356 of 3365) nll 2.1669 gpu 95% free 78% | delta sent 0.2s, waited 135.1s, update 0.0s
round 11: 15649/91899 lr×1.000 eta 310m | dbc 766 steps 7053 tok/s nll 2.1189 | evo 166 steps 1672 tok/s nll 2.1597 | dgx 471 steps 4249 tok/s nll 2.1475 | 306.6s, closed 6.6s past the deadline, outer step 0.0s
worker 0 round 11: 766 steps 7053 tok/s (7445 padded; contexts 5035 of 5055) nll 2.1189 gpu 94% free 80% | delta sent 0.1s, waited 6.4s, update 0.1s
round 12: 17044/91899 lr×1.000 eta 301m | dbc 766 steps 7061 tok/s nll 2.0992 | evo 171 steps 1768 tok/s nll 2.2402 | dgx 458 steps 4216 tok/s nll 2.1588 | 308.5s, closed 8.5s past the deadline, outer step 0.0s
worker 0 round 12: 766 steps 7061 tok/s (7440 padded; contexts 5024 of 5038) nll 2.0992 gpu 93% free 80% | delta sent 0.1s, waited 7.8s, update 0.0s
round 13: 18444/91899 lr×1.000 eta 293m | dbc 773 steps 7026 tok/s nll 2.0401 | evo 160 steps 1709 tok/s nll 2.0042 | dgx 467 steps 4263 tok/s nll 2.0673 | 306.7s, closed 6.7s past the deadline, outer step 0.0s
worker 0 round 13: 773 steps 7026 tok/s (7420 padded; contexts 5003 of 5014) nll 2.0401 gpu 94% free 81% | delta sent 0.1s, waited 6.3s, update 0.0s
round 14: 19837/91899 lr×1.000 eta 286m | dbc 758 steps 7065 tok/s nll 2.0450 | evo 173 steps 1663 tok/s nll 2.2869 | dgx 462 steps 4182 tok/s nll 1.9836 | 307.3s, closed 7.3s past the deadline, outer step 0.0s
worker 0 round 14: 758 steps 7065 tok/s (7464 padded; contexts 5089 of 5114) nll 2.0450 gpu 94% free 80% | delta sent 0.1s, waited 6.8s, update 0.0s
round 15: 21271/91899 lr×1.000 eta 278m | dbc 761 steps 7059 tok/s nll 1.9950 | evo 204 steps 2058 tok/s nll 2.0689 | dgx 469 steps 4293 tok/s nll 2.1065 | 307.3s, closed 7.3s past the deadline, outer step 0.0s
worker 0 round 15: 761 steps 7059 tok/s (7441 padded; contexts 5156 of 5176) nll 1.9950 gpu 94% free 80% | delta sent 0.1s, waited 7.0s, update 0.1s
round 16: 22667/91899 lr×1.000 eta 271m | dbc 766 steps 7057 tok/s nll 2.0237 | evo 165 steps 1781 tok/s nll 1.9965 | dgx 465 steps 4232 tok/s nll 2.0921 | 306.6s, closed 6.6s past the deadline, outer step 0.0s
worker 0 round 16: 766 steps 7057 tok/s (7444 padded; contexts 5110 of 5123) nll 2.0237 gpu 94% free 80% | delta sent 0.1s, waited 6.3s, update 0.0s
round 17: 24082/91899 lr×1.000 eta 264m | dbc 771 steps 6974 tok/s nll 2.0605 | evo 185 steps 1974 tok/s nll 1.9028 | dgx 459 steps 4244 tok/s nll 1.9756 | 308.4s, closed 8.4s past the deadline, outer step 0.0s
worker 0 round 17: 771 steps 6974 tok/s (7368 padded; contexts 4943 of 4958) nll 2.0605 gpu 94% free 80% | delta sent 0.1s, waited 8.0s, update 0.0s, state kept
val: 1466 wide rows over 394180 options, each answered over all of them, retrieval's top 32 by the head (127s); 11988 rows by the head (310s)
val @24082: action 0.340/1.785  ag_news 0.807/0.693  arch 0.660/0.842  banking77 0.216/3.040  boolq 0.629/0.665  clinc150 0.133/3.406  code.affected.gold 0.482/0.695  code.failure.silver 0.474/1.558  code.file.gold 0.062/4.684  code.suspect.gold 0.000/4.959  code.symbol.gold 0.060/4.302  code.test.silver 0.062/3.721  control.commit.gold 0.190/0.737  control.context.gold 0.806/0.829  control.continue.gold 0.048/0.845  control.done.gold 0.091/0.711  control.repeat.gold 1.000/0.613  control.retry.gold 0.000/0.791  control.rollback.gold 0.571/0.693  control.strategy.gold 0.750/0.641  control.user.silver 0.875/0.458  done 0.017/0.824  email_spam 0.990/0.047  emotion 0.542/1.237  function 0.425/2.173  graph_typed 0.437/1.165  guardrails_jailbreak 0.355/0.835  massive 0.625/1.238  mnli 0.637/0.845  model_routing_domain 0.502/1.507  moderation_toxicity 0.868/0.406  nemotron 0.410/2.314  phishing 0.942/0.249  rag_relevance 0.505/0.701  readiness 0.430/1.167  resolve 0.130/0.729  rig 0.460/1.145  risk 0.000/1.949  skills.select.silver 0.000/7.366  sst5 0.338/1.802  support_triage 0.398/1.789  sysml 0.590/0.727  testplan 0.615/1.081  tool 0.090/2.397  trade 0.495/0.937  turbofan 0.485/1.028  typed_decisions 0.520/1.161  xnli 0.675/0.858
saved /Users/a/scratch/decision/runs/a at 24082 batches, 0 epochs
round 18: 25282/91899 lr×1.000 eta 268m | dbc 531 steps 4806 tok/s nll 1.9831 | evo 202 steps 2066 tok/s nll 1.9394 | dgx 467 steps 4287 tok/s nll 2.0452 | 440.4s, closed 140.4s past the deadline, outer step 0.0s
worker 0 round 18: 531 steps 4806 tok/s (5082 padded; contexts 3411 of 3425) nll 1.9831 gpu 95% free 78% | delta sent 0.1s, waited 139.1s, update 0.0s
round 19: 26718/91899 lr×1.000 eta 260m | dbc 770 steps 7051 tok/s nll 1.9715 | evo 191 steps 1965 tok/s nll 1.9598 | dgx 475 steps 4296 tok/s nll 1.9843 | 311.3s, closed 11.3s past the deadline, outer step 0.1s
worker 0 round 19: 770 steps 7051 tok/s (7445 padded; contexts 5016 of 5029) nll 1.9715 gpu 93% free 80% | delta sent 0.1s, waited 10.8s, update 0.0s
round 20: 28106/91899 lr×1.000 eta 254m | dbc 770 steps 7001 tok/s nll 1.9573 | evo 153 steps 1634 tok/s nll 1.8430 | dgx 465 steps 4255 tok/s nll 2.0058 | 307.0s, closed 7.0s past the deadline, outer step 0.0s
worker 0 round 20: 770 steps 7001 tok/s (7394 padded; contexts 4960 of 4975) nll 1.9573 gpu 94% free 81% | delta sent 0.1s, waited 6.6s, update 0.0s
round 21: 29500/91899 lr×1.000 eta 247m | dbc 770 steps 7036 tok/s nll 2.0272 | evo 163 steps 1700 tok/s nll 1.8799 | dgx 461 steps 4255 tok/s nll 1.9244 | 306.8s, closed 6.8s past the deadline, outer step 0.0s
worker 0 round 21: 770 steps 7036 tok/s (7448 padded; contexts 4920 of 4942) nll 2.0272 gpu 94% free 80% | delta sent 0.1s, waited 6.2s, update 0.1s
round 22: 30968/91899 lr×1.000 eta 240m | dbc 781 steps 6942 tok/s nll 2.0425 | evo 233 steps 2388 tok/s nll 2.1450 | dgx 454 steps 4322 tok/s nll 1.8150 | 307.4s, closed 7.4s past the deadline, outer step 0.0s
worker 0 round 22: 781 steps 6942 tok/s (7343 padded; contexts 4851 of 4866) nll 2.0425 gpu 94% free 80% | delta sent 0.1s, waited 7.2s, update 0.0s
round 23: 32382/91899 lr×1.000 eta 233m | dbc 775 steps 6998 tok/s nll 1.9633 | evo 166 steps 1758 tok/s nll 1.8510 | dgx 473 steps 4227 tok/s nll 1.9930 | 306.8s, closed 6.8s past the deadline, outer step 0.0s
worker 0 round 23: 775 steps 6998 tok/s (7382 padded; contexts 5008 of 5020) nll 1.9633 gpu 94% free 80% | delta sent 0.1s, waited 6.2s, update 0.0s
round 24: 33788/91899 lr×1.000 eta 227m | dbc 767 steps 7015 tok/s nll 2.0195 | evo 170 steps 1697 tok/s nll 1.9206 | dgx 469 steps 4258 tok/s nll 1.9033 | 306.6s, closed 6.6s past the deadline, outer step 0.0s
worker 0 round 24: 767 steps 7015 tok/s (7408 padded; contexts 4998 of 5015) nll 2.0195 gpu 94% free 81% | delta sent 0.1s, waited 6.2s, update 0.0s
round 25: 35184/91899 lr×1.000 eta 221m | dbc 760 steps 6999 tok/s nll 1.9478 | evo 164 steps 1655 tok/s nll 1.9603 | dgx 472 steps 4287 tok/s nll 1.9854 | 308.5s, closed 8.5s past the deadline, outer step 0.0s
worker 0 round 25: 760 steps 6999 tok/s (7381 padded; contexts 5004 of 5017) nll 1.9478 gpu 94% free 81% | delta sent 0.1s, waited 7.9s, update 0.0s
round 26: 36588/91899 lr×1.000 eta 215m | dbc 763 steps 6999 tok/s nll 1.9487 | evo 186 steps 1842 tok/s nll 2.0885 | dgx 455 steps 4275 tok/s nll 1.8583 | 308.8s, closed 8.8s past the deadline, outer step 0.0s
worker 0 round 26: 763 steps 6999 tok/s (7390 padded; contexts 4982 of 4995) nll 1.9487 gpu 93% free 81% | delta sent 0.1s, waited 8.6s, update 0.0s, state kept
val: 1466 wide rows over 394180 options, each answered over all of them, retrieval's top 32 by the head (126s); 11988 rows by the head (310s)
val @36588: action 0.347/1.840  ag_news 0.797/0.597  arch 0.660/0.854  banking77 0.278/2.462  boolq 0.635/0.652  clinc150 0.195/2.821  code.affected.gold 0.515/0.694  code.failure.silver 0.211/1.585  code.file.gold 0.072/4.773  code.suspect.gold 0.000/4.947  code.symbol.gold 0.075/4.251  code.test.silver 0.058/3.680  control.commit.gold 0.190/0.726  control.context.gold 0.806/0.888  control.continue.gold 0.048/1.070  control.done.gold 0.727/0.674  control.repeat.gold 0.000/0.758  control.retry.gold 1.000/0.633  control.rollback.gold 0.429/0.779  control.strategy.gold 0.750/0.564  control.user.silver 1.000/0.190  done 0.983/0.412  email_spam 0.978/0.080  emotion 0.534/1.241  function 0.500/1.965  graph_typed 0.489/1.151  guardrails_jailbreak 0.338/0.920  massive 0.662/1.114  mnli 0.595/0.910  model_routing_domain 0.973/0.223  moderation_toxicity 0.498/0.722  nemotron 0.425/2.287  phishing 0.936/0.203  rag_relevance 0.470/0.698  readiness 0.505/1.101  resolve 0.598/0.698  rig 0.460/1.141  risk 0.087/0.998  skills.select.silver 0.000/7.263  sst5 0.338/1.549  support_triage 0.343/1.787  sysml 0.590/0.760  testplan 0.615/1.099  tool 0.090/2.461  trade 0.613/0.912  turbofan 0.600/0.985  typed_decisions 0.549/1.103  xnli 0.630/0.848
saved /Users/a/scratch/decision/runs/a at 36588 batches, 0 epochs
round 27: 37762/91899 lr×1.000 eta 215m | dbc 523 steps 4822 tok/s nll 1.9830 | evo 182 steps 1823 tok/s nll 1.9557 | dgx 469 steps 4248 tok/s nll 1.8960 | 438.4s, closed 138.4s past the deadline, outer step 0.0s
worker 0 round 27: 523 steps 4822 tok/s (5106 padded; contexts 3412 of 3420) nll 1.9830 gpu 96% free 78% | delta sent 0.1s, waited 137.4s, update 0.0s
round 28: 39174/91899 lr×1.000 eta 208m | dbc 764 steps 6988 tok/s nll 1.9373 | evo 180 steps 1852 tok/s nll 2.0263 | dgx 468 steps 4224 tok/s nll 1.9012 | 306.6s, closed 6.6s past the deadline, outer step 0.0s
worker 0 round 28: 764 steps 6988 tok/s (7384 padded; contexts 4989 of 5003) nll 1.9373 gpu 95% free 81% | delta sent 0.1s, waited 6.0s, update 0.0s
round 29: 40618/91899 lr×1.000 eta 202m | dbc 776 steps 7015 tok/s nll 1.9470 | evo 203 steps 2070 tok/s nll 2.0079 | dgx 465 steps 4189 tok/s nll 1.8603 | 306.9s, closed 6.9s past the deadline, outer step 0.0s
worker 0 round 29: 776 steps 7015 tok/s (7417 padded; contexts 4982 of 5000) nll 1.9470 gpu 94% free 81% | delta sent 0.1s, waited 6.5s, update 0.0s
round 30: 42050/91899 lr×1.000 eta 196m | dbc 775 steps 6918 tok/s nll 1.9608 | evo 208 steps 2144 tok/s nll 1.9339 | dgx 449 steps 4211 tok/s nll 1.7986 | 307.5s, closed 7.5s past the deadline, outer step 0.0s
worker 0 round 30: 775 steps 6918 tok/s (7319 padded; contexts 4823 of 4844) nll 1.9608 gpu 94% free 81% | delta sent 0.1s, waited 7.0s, update 0.0s
round 31: 43452/91899 lr×1.000 eta 190m | dbc 764 steps 6969 tok/s nll 1.9717 | evo 179 steps 1803 tok/s nll 1.8632 | dgx 459 steps 4301 tok/s nll 1.8471 | 307.4s, closed 7.4s past the deadline, outer step 0.0s
worker 0 round 31: 764 steps 6969 tok/s (7361 padded; contexts 4969 of 4983) nll 1.9717 gpu 94% free 81% | delta sent 0.1s, waited 6.9s, update 0.0s
round 32: 44854/91899 lr×1.000 eta 184m | dbc 764 steps 7002 tok/s nll 1.9681 | evo 171 steps 1660 tok/s nll 1.8920 | dgx 467 steps 4326 tok/s nll 1.8949 | 307.6s, closed 7.6s past the deadline, outer step 0.0s
worker 0 round 32: 764 steps 7002 tok/s (7388 padded; contexts 4987 of 4999) nll 1.9681 gpu 94% free 81% | delta sent 0.1s, waited 7.4s, update 0.0s
round 33: 46268/91899 lr×1.000 eta 178m | dbc 763 steps 7036 tok/s nll 1.8776 | evo 177 steps 1822 tok/s nll 1.8478 | dgx 474 steps 4284 tok/s nll 1.9790 | 306.6s, closed 6.6s past the deadline, outer step 0.0s
worker 0 round 33: 763 steps 7036 tok/s (7407 padded; contexts 5100 of 5114) nll 1.8776 gpu 94% free 81% | delta sent 0.1s, waited 6.3s, update 0.0s
round 34: 47668/91899 lr×1.000 eta 172m | dbc 762 steps 6983 tok/s nll 1.9534 | evo 176 steps 1768 tok/s nll 1.9451 | dgx 462 steps 4260 tok/s nll 1.8600 | 307.3s, closed 7.3s past the deadline, outer step 0.0s
worker 0 round 34: 762 steps 6983 tok/s (7377 padded; contexts 4959 of 4973) nll 1.9534 gpu 94% free 80% | delta sent 0.1s, waited 6.8s, update 0.0s
round 35: 49071/91899 lr×1.000 eta 166m | dbc 767 steps 6970 tok/s nll 1.9479 | evo 180 steps 1781 tok/s nll 2.0437 | dgx 456 steps 4276 tok/s nll 1.8649 | 309.7s, closed 9.7s past the deadline, outer step 0.0s
worker 0 round 35: 767 steps 6970 tok/s (7350 padded; contexts 4946 of 4959) nll 1.9479 gpu 93% free 81% | delta sent 0.1s, waited 9.5s, update 0.0s, state kept
val: 1466 wide rows over 394180 options, each answered over all of them, retrieval's top 32 by the head (128s); 11988 rows by the head (309s)
val @49071: action 0.155/1.856  ag_news 0.830/0.498  arch 0.667/0.834  banking77 0.287/2.348  boolq 0.640/0.649  clinc150 0.290/2.587  code.affected.gold 0.517/0.693  code.failure.silver 0.211/1.811  code.file.gold 0.068/4.483  code.suspect.gold 0.000/5.061  code.symbol.gold 0.089/4.279  code.test.silver 0.052/3.739  control.commit.gold 0.476/0.687  control.context.gold 0.806/0.798  control.continue.gold 0.048/0.797  control.done.gold 0.909/0.677  control.repeat.gold 1.000/0.544  control.retry.gold 0.000/0.737  control.rollback.gold 0.429/0.727  control.strategy.gold 0.750/0.544  control.user.silver 0.875/0.370  done 0.983/0.470  email_spam 0.990/0.053  emotion 0.583/1.168  function 0.507/1.731  graph_typed 0.533/1.159  guardrails_jailbreak 0.965/0.117  massive 0.670/1.045  mnli 0.608/0.872  model_routing_domain 0.980/0.108  moderation_toxicity 0.798/0.381  nemotron 0.383/2.265  phishing 0.964/0.109  rag_relevance 0.482/0.696  readiness 0.460/1.104  resolve 0.978/0.628  rig 0.477/1.224  risk 0.990/0.748  skills.select.silver 0.000/7.279  sst5 0.157/1.586  support_triage 0.323/1.795  sysml 0.608/0.724  testplan 0.625/0.970  tool 0.090/2.480  trade 0.588/0.893  turbofan 0.482/1.073  typed_decisions 0.531/1.140  xnli 0.625/0.869
saved /Users/a/scratch/decision/runs/a at 49071 batches, 0 epochs
round 36: 50230/91899 lr×1.000 eta 164m | dbc 530 steps 4809 tok/s nll 1.9690 | evo 172 steps 1798 tok/s nll 1.7815 | dgx 457 steps 4273 tok/s nll 1.9114 | 439.5s, closed 139.5s past the deadline, outer step 0.0s
worker 0 round 36: 530 steps 4809 tok/s (5067 padded; contexts 3456 of 3466) nll 1.9690 gpu 95% free 78% | delta sent 0.1s, waited 138.3s, update 0.0s
round 37: 51624/91899 lr×1.000 eta 158m | dbc 760 steps 6989 tok/s nll 1.9141 | evo 173 steps 1776 tok/s nll 1.8844 | dgx 461 steps 4276 tok/s nll 1.7900 | 306.8s, closed 6.8s past the deadline, outer step 0.0s
worker 0 round 37: 760 steps 6989 tok/s (7398 padded; contexts 4966 of 4986) nll 1.9141 gpu 94% free 80% | delta sent 0.1s, waited 6.5s, update 0.0s
round 38: 53023/91899 lr×1.000 eta 153m | dbc 751 steps 6946 tok/s nll 1.8727 | evo 174 steps 1798 tok/s nll 1.9717 | dgx 474 steps 4331 tok/s nll 1.9226 | 308.2s, closed 8.2s past the deadline, outer step 0.0s
worker 0 round 38: 751 steps 6946 tok/s (7326 padded; contexts 5035 of 5056) nll 1.8727 gpu 94% free 81% | delta sent 0.1s, waited 7.9s, update 0.0s
round 39: 54426/91899 lr×1.000 eta 147m | dbc 761 steps 6931 tok/s nll 1.9512 | evo 175 steps 1812 tok/s nll 1.9429 | dgx 467 steps 4337 tok/s nll 1.8056 | 307.6s, closed 7.6s past the deadline, outer step 0.0s
worker 0 round 39: 761 steps 6931 tok/s (7329 padded; contexts 4892 of 4905) nll 1.9512 gpu 94% free 79% | delta sent 0.1s, waited 7.1s, update 0.0s
round 40: 55833/91899 lr×1.000 eta 141m | dbc 752 steps 7064 tok/s nll 1.8408 | evo 188 steps 1881 tok/s nll 1.9521 | dgx 467 steps 4239 tok/s nll 1.9816 | 308.2s, closed 8.2s past the deadline, outer step 0.0s
worker 0 round 40: 752 steps 7064 tok/s (7439 padded; contexts 5150 of 5170) nll 1.8408 gpu 94% free 79% | delta sent 0.1s, waited 7.9s, update 0.0s
round 41: 57230/91899 lr×1.000 eta 135m | dbc 762 steps 7023 tok/s nll 1.8894 | evo 171 steps 1731 tok/s nll 1.8562 | dgx 464 steps 4201 tok/s nll 1.8681 | 308.6s, closed 8.6s past the deadline, outer step 0.0s
worker 0 round 41: 762 steps 7023 tok/s (7430 padded; contexts 4952 of 4966) nll 1.8894 gpu 93% free 79% | delta sent 0.1s, waited 8.4s, update 0.0s
round 42: 58640/91899 lr×1.000 eta 130m | dbc 768 steps 6985 tok/s nll 1.8982 | evo 186 steps 1876 tok/s nll 1.8580 | dgx 456 steps 4290 tok/s nll 1.9110 | 307.1s, closed 7.1s past the deadline, outer step 0.0s
worker 0 round 42: 768 steps 6985 tok/s (7367 padded; contexts 4998 of 5011) nll 1.8982 gpu 94% free 79% | delta sent 0.1s, waited 6.8s, update 0.0s
round 43: 60056/91899 lr×1.000 eta 124m | dbc 771 steps 6967 tok/s nll 1.8767 | evo 185 steps 1913 tok/s nll 1.9525 | dgx 460 steps 4342 tok/s nll 1.8119 | 306.3s, closed 6.3s past the deadline, outer step 0.0s
worker 0 round 43: 771 steps 6967 tok/s (7371 padded; contexts 4936 of 4955) nll 1.8767 gpu 94% free 79% | delta sent 0.1s, waited 5.7s, update 0.0s, state kept
val: 1466 wide rows over 394180 options, each answered over all of them, retrieval's top 32 by the head (134s); 11988 rows by the head (315s)
val @60056: action 0.343/1.768  ag_news 0.843/0.528  arch 0.670/0.865  banking77 0.349/2.307  boolq 0.586/0.663  clinc150 0.287/2.584  code.affected.gold 0.595/0.691  code.failure.silver 0.158/1.815  code.file.gold 0.068/4.322  code.suspect.gold 0.000/4.895  code.symbol.gold 0.100/4.268  code.test.silver 0.060/3.622  control.commit.gold 0.810/0.514  control.context.gold 0.806/0.879  control.continue.gold 0.952/0.594  control.done.gold 0.909/0.479  control.repeat.gold 1.000/0.613  control.retry.gold 1.000/0.633  control.rollback.gold 0.429/0.697  control.strategy.gold 0.750/0.601  control.user.silver 0.875/0.378  done 0.983/0.328  email_spam 0.985/0.060  emotion 0.589/1.131  function 0.520/1.848  graph_typed 0.496/1.138  guardrails_jailbreak 0.983/0.070  massive 0.665/1.030  mnli 0.580/0.921  model_routing_domain 0.963/0.169  moderation_toxicity 0.861/0.255  nemotron 0.357/2.492  phishing 0.967/0.110  rag_relevance 0.527/0.691  readiness 0.485/1.138  resolve 0.095/0.731  rig 0.448/1.082  risk 0.000/1.598  skills.select.silver 0.000/7.173  sst5 0.338/1.568  support_triage 0.365/1.737  sysml 0.608/0.772  testplan 0.615/1.010  tool 0.110/2.411  trade 0.625/0.832  turbofan 0.480/0.993  typed_decisions 0.577/1.065  xnli 0.613/0.883
saved /Users/a/scratch/decision/runs/a at 60056 batches, 0 epochs
round 44: 61213/91899 lr×1.000 eta 121m | dbc 510 steps 4683 tok/s nll 1.8679 | evo 170 steps 1807 tok/s nll 1.8042 | dgx 477 steps 4243 tok/s nll 1.8845 | 450.8s, closed 150.8s past the deadline, outer step 0.0s
worker 0 round 44: 510 steps 4683 tok/s (4953 padded; contexts 3353 of 3364) nll 1.8679 gpu 95% free 79% | delta sent 0.1s, waited 149.5s, update 0.0s
round 45: 62661/91899 lr×1.000 eta 115m | dbc 757 steps 7054 tok/s nll 1.8645 | evo 226 steps 2325 tok/s nll 1.9378 | dgx 465 steps 4226 tok/s nll 1.9118 | 309.2s, closed 9.2s past the deadline, outer step 0.0s
worker 0 round 45: 757 steps 7054 tok/s (7434 padded; contexts 5110 of 5131) nll 1.8645 gpu 93% free 78% | delta sent 0.1s, waited 8.8s, update 0.0s
round 46: 64066/91899 lr×1.000 eta 109m | dbc 760 steps 6961 tok/s nll 1.8746 | evo 175 steps 1791 tok/s nll 1.8443 | dgx 470 steps 4223 tok/s nll 1.9061 | 306.6s, closed 6.6s past the deadline, outer step 0.0s
worker 0 round 46: 760 steps 6961 tok/s (7353 padded; contexts 4993 of 5004) nll 1.8746 gpu 94% free 78% | delta sent 0.1s, waited 6.2s, update 0.0s
round 47: 65461/91899 lr×1.000 eta 104m | dbc 755 steps 6979 tok/s nll 1.9022 | evo 175 steps 1757 tok/s nll 1.8694 | dgx 465 steps 4306 tok/s nll 1.8275 | 307.7s, closed 7.7s past the deadline, outer step 0.0s
worker 0 round 47: 755 steps 6979 tok/s (7344 padded; contexts 5033 of 5046) nll 1.9022 gpu 94% free 78% | delta sent 0.1s, waited 7.2s, update 0.0s
round 48: 66871/91899 lr×1.000 eta 98m | dbc 769 steps 6971 tok/s nll 1.8257 | evo 177 steps 1818 tok/s nll 1.9504 | dgx 464 steps 4206 tok/s nll 1.9381 | 308.0s, closed 8.0s past the deadline, outer step 0.0s
worker 0 round 48: 769 steps 6971 tok/s (7344 padded; contexts 5046 of 5059) nll 1.8257 gpu 93% free 79% | delta sent 0.1s, waited 7.8s, update 0.0s
round 49: 68292/91899 lr×1.000 eta 92m | dbc 765 steps 6934 tok/s nll 1.9405 | evo 198 steps 1975 tok/s nll 1.9024 | dgx 458 steps 4245 tok/s nll 1.7913 | 308.0s, closed 8.0s past the deadline, outer step 0.0s
worker 0 round 49: 765 steps 6934 tok/s (7320 padded; contexts 4916 of 4930) nll 1.9405 gpu 94% free 78% | delta sent 0.1s, waited 7.7s, update 0.0s
round 50: 69678/91899 lr×1.000 eta 87m | dbc 751 steps 7022 tok/s nll 1.8914 | evo 162 steps 1729 tok/s nll 1.8672 | dgx 473 steps 4281 tok/s nll 1.8392 | 307.8s, closed 7.8s past the deadline, outer step 0.1s
worker 0 round 50: 751 steps 7022 tok/s (7391 padded; contexts 5086 of 5097) nll 1.8914 gpu 94% free 79% | delta sent 0.1s, waited 7.1s, update 0.0s
round 51: 71063/91899 lr×1.000 eta 81m | dbc 759 steps 6902 tok/s nll 1.9383 | evo 171 steps 1780 tok/s nll 1.7479 | dgx 455 steps 4301 tok/s nll 1.8480 | 308.3s, closed 8.3s past the deadline, outer step 0.0s
worker 0 round 51: 759 steps 6902 tok/s (7304 padded; contexts 4873 of 4889) nll 1.9383 gpu 93% free 77% | delta sent 0.1s, waited 8.0s, update 0.0s
round 52: 72490/91899 lr×1.000 eta 76m | dbc 757 steps 6957 tok/s nll 1.8796 | evo 204 steps 2093 tok/s nll 1.7970 | dgx 466 steps 4235 tok/s nll 1.8202 | 307.4s, closed 7.4s past the deadline, outer step 0.0s
worker 0 round 52: 757 steps 6957 tok/s (7354 padded; contexts 4955 of 4976) nll 1.8796 gpu 94% free 77% | delta sent 0.1s, waited 6.9s, update 0.0s, state kept
val: 1466 wide rows over 394180 options, each answered over all of them, retrieval's top 32 by the head (132s); 11988 rows by the head (314s)
val @72490: action 0.365/1.725  ag_news 0.850/0.461  arch 0.670/0.830  banking77 0.378/2.175  boolq 0.553/0.685  clinc150 0.372/2.234  code.affected.gold 0.527/0.692  code.failure.silver 0.263/1.605  code.file.gold 0.065/4.273  code.suspect.gold 0.048/5.080  code.symbol.gold 0.057/4.378  code.test.silver 0.055/3.744  control.commit.gold 0.476/0.680  control.context.gold 0.806/0.826  control.continue.gold 0.048/1.012  control.done.gold 0.727/0.666  control.repeat.gold 1.000/0.320  control.retry.gold 0.000/0.826  control.rollback.gold 0.571/0.676  control.strategy.gold 0.750/0.756  control.user.silver 0.875/0.351  done 0.983/0.242  email_spam 0.983/0.074  emotion 0.609/0.968  function 0.535/1.697  graph_typed 0.541/1.115  guardrails_jailbreak 0.819/0.543  massive 0.680/0.947  mnli 0.603/0.936  model_routing_domain 0.983/0.067  moderation_toxicity 0.721/0.527  nemotron 0.378/2.302  phishing 0.969/0.155  rag_relevance 0.505/0.702  readiness 0.443/1.141  resolve 0.058/0.741  rig 0.450/1.079  risk 0.000/1.287  skills.select.silver 0.000/7.238  sst5 0.108/1.695  support_triage 0.378/1.784  sysml 0.608/0.769  testplan 0.608/0.954  tool 0.090/2.467  trade 0.618/0.808  turbofan 0.482/1.122  typed_decisions 0.566/1.061  xnli 0.603/0.935
saved /Users/a/scratch/decision/runs/a at 72490 batches, 0 epochs
round 53: 73655/91899 lr×0.993 eta 72m | dbc 513 steps 4620 tok/s nll 1.7949 | evo 178 steps 1818 tok/s nll 1.8447 | dgx 474 steps 4307 tok/s nll 1.9372 | 449.1s, closed 149.1s past the deadline, outer step 0.0s
worker 0 round 53: 513 steps 4620 tok/s (4867 padded; contexts 3313 of 3322) nll 1.7949 gpu 96% free 74% | delta sent 0.1s, waited 147.8s, update 0.0s
round 54: 75059/91899 lr×0.925 eta 66m | dbc 764 steps 6983 tok/s nll 1.7793 | evo 172 steps 1752 tok/s nll 1.8849 | dgx 468 steps 4298 tok/s nll 1.9137 | 306.9s, closed 6.9s past the deadline, outer step 0.0s
worker 0 round 54: 764 steps 6983 tok/s (7361 padded; contexts 5069 of 5083) nll 1.7793 gpu 94% free 75% | delta sent 0.1s, waited 6.3s, update 0.0s
round 55: 76465/91899 lr×0.856 eta 61m | dbc 760 steps 6932 tok/s nll 1.9055 | evo 185 steps 1895 tok/s nll 1.8846 | dgx 461 steps 4187 tok/s nll 1.8433 | 308.5s, closed 8.5s past the deadline, outer step 0.0s
worker 0 round 55: 760 steps 6932 tok/s (7319 padded; contexts 4926 of 4938) nll 1.9055 gpu 94% free 76% | delta sent 0.1s, waited 7.8s, update 0.0s
round 56: 77860/91899 lr×0.787 eta 55m | dbc 755 steps 6982 tok/s nll 1.8324 | evo 177 steps 1783 tok/s nll 1.7851 | dgx 463 steps 4209 tok/s nll 1.8979 | 306.8s, closed 6.8s past the deadline, outer step 0.0s
worker 0 round 56: 755 steps 6982 tok/s (7375 padded; contexts 5030 of 5048) nll 1.8324 gpu 94% free 76% | delta sent 0.1s, waited 6.3s, update 0.0s
round 57: 79251/91899 lr×0.719 eta 50m | dbc 759 steps 6930 tok/s nll 1.8809 | evo 166 steps 1773 tok/s nll 1.6993 | dgx 466 steps 4239 tok/s nll 1.8204 | 308.4s, closed 8.4s past the deadline, outer step 0.0s
worker 0 round 57: 759 steps 6930 tok/s (7329 padded; contexts 4885 of 4901) nll 1.8809 gpu 94% free 76% | delta sent 0.1s, waited 8.0s, update 0.0s
round 58: 80656/91899 lr×0.651 eta 44m | dbc 759 steps 6976 tok/s nll 1.8246 | evo 175 steps 1820 tok/s nll 1.8052 | dgx 471 steps 4299 tok/s nll 1.8980 | 308.0s, closed 8.0s past the deadline, outer step 0.0s
worker 0 round 58: 759 steps 6976 tok/s (7371 padded; contexts 4984 of 5004) nll 1.8246 gpu 94% free 76% | delta sent 0.1s, waited 7.5s, update 0.0s
round 59: 82055/91899 lr×0.582 eta 38m | dbc 763 steps 6980 tok/s nll 1.8025 | evo 173 steps 1787 tok/s nll 1.8192 | dgx 463 steps 4214 tok/s nll 1.8865 | 308.7s, closed 8.7s past the deadline, outer step 0.0s
worker 0 round 59: 763 steps 6980 tok/s (7375 padded; contexts 4971 of 4998) nll 1.8025 gpu 91% free 76% | delta sent 0.1s, waited 8.2s, update 0.0s
cluster: 10.0.0.19:34202: failed to fill whole buffer
cluster: dgx left; requeued 413 batches
round 60: 82998/91899 lr×0.536 eta 35m | dbc 765 steps 6906 tok/s nll 1.7999 | evo 178 steps 1804 tok/s nll 1.8352 | 306.7s, closed 6.7s past the deadline, outer step 0.0s
worker 0 round 60: 765 steps 6906 tok/s (7281 padded; contexts 4953 of 4967) nll 1.7999 gpu 94% free 76% | delta sent 0.1s, waited 6.1s, update 0.0s
round 61: 83939/91899 lr×0.490 eta 31m | dbc 755 steps 6949 tok/s nll 1.7942 | evo 186 steps 1831 tok/s nll 2.0111 | 306.7s, closed 6.7s past the deadline, outer step 0.0s
worker 0 round 61: 755 steps 6949 tok/s (7337 padded; contexts 4993 of 5013) nll 1.7942 gpu 95% free 76% | delta sent 0.1s, waited 6.3s, update 0.0s
round 62: 84900/91899 lr×0.443 eta 28m | dbc 760 steps 6941 tok/s nll 1.8332 | evo 201 steps 2116 tok/s nll 1.7729 | 306.1s, closed 6.1s past the deadline, outer step 0.0s
worker 0 round 62: 760 steps 6941 tok/s (7335 padded; contexts 4966 of 4985) nll 1.8332 gpu 95% free 76% | delta sent 0.1s, waited 5.9s, update 0.0s, state kept
val: 1466 wide rows over 394180 options, each answered over all of them, retrieval's top 32 by the head (128s); 11988 rows by the head (310s)
val @84900: action 0.372/1.717  ag_news 0.860/0.482  arch 0.672/0.896  banking77 0.474/1.997  boolq 0.629/0.653  clinc150 0.400/2.152  code.affected.gold 0.530/0.694  code.failure.silver 0.263/1.671  code.file.gold 0.077/4.222  code.suspect.gold 0.000/4.972  code.symbol.gold 0.100/4.308  code.test.silver 0.040/3.641  control.commit.gold 0.190/0.739  control.context.gold 0.806/0.876  control.continue.gold 0.952/0.427  control.done.gold 0.545/0.666  control.repeat.gold 1.000/0.461  control.retry.gold 0.000/0.826  control.rollback.gold 0.286/0.713  control.strategy.gold 0.750/0.597  control.user.silver 0.875/0.352  done 0.983/0.340  email_spam 0.983/0.056  emotion 0.662/0.945  function 0.552/1.690  graph_typed 0.467/1.147  guardrails_jailbreak 0.972/0.135  massive 0.713/0.931  mnli 0.583/0.924  model_routing_domain 0.975/0.092  moderation_toxicity 0.686/0.592  nemotron 0.403/2.230  phishing 0.916/0.308  rag_relevance 0.525/0.696  readiness 0.443/1.101  resolve 0.875/0.451  rig 0.460/1.083  risk 0.010/1.952  skills.select.silver 0.000/7.193  sst5 0.338/1.529  support_triage 0.388/1.754  sysml 0.610/0.704  testplan 0.615/0.978  tool 0.250/2.419  trade 0.585/0.809  turbofan 0.505/1.031  typed_decisions 0.509/1.109  xnli 0.590/0.916
saved /Users/a/scratch/decision/runs/a at 84900 batches, 0 epochs
round 63: 85586/91899 lr×0.409 eta 25m | dbc 527 steps 4760 tok/s nll 1.8416 | evo 159 steps 1659 tok/s nll 1.7111 | 441.0s, closed 141.0s past the deadline, outer step 0.0s
worker 0 round 63: 527 steps 4760 tok/s (5019 padded; contexts 3359 of 3367) nll 1.8416 gpu 94% free 74% | delta sent 0.1s, waited 140.2s, update 0.0s
round 64: 86519/91899 lr×0.363 eta 22m | dbc 764 steps 6975 tok/s nll 1.8543 | evo 169 steps 1759 tok/s nll 1.7564 | 305.8s, closed 5.8s past the deadline, outer step 0.0s
worker 0 round 64: 764 steps 6975 tok/s (7367 padded; contexts 4945 of 4961) nll 1.8543 gpu 94% free 76% | delta sent 0.1s, waited 5.6s, update 0.1s
round 65: 87452/91899 lr×0.318 eta 18m | dbc 762 steps 6969 tok/s nll 1.8492 | evo 171 steps 1729 tok/s nll 1.7558 | 306.2s, closed 6.2s past the deadline, outer step 0.0s
worker 0 round 65: 762 steps 6969 tok/s (7383 padded; contexts 4900 of 4914) nll 1.8492 gpu 95% free 76% | delta sent 0.1s, waited 5.5s, update 0.0s
round 66: 88422/91899 lr×0.270 eta 14m | dbc 760 steps 6976 tok/s nll 1.7711 | evo 210 steps 2152 tok/s nll 1.8092 | 307.7s, closed 7.7s past the deadline, outer step 0.0s
worker 0 round 66: 760 steps 6976 tok/s (7361 padded; contexts 4995 of 5014) nll 1.7711 gpu 94% free 76% | delta sent 0.1s, waited 7.2s, update 0.0s
round 67: 89386/91899 lr×0.223 eta 10m | dbc 756 steps 6942 tok/s nll 1.8216 | evo 208 steps 2074 tok/s nll 1.8693 | 305.1s, closed 5.1s past the deadline, outer step 0.0s
worker 0 round 67: 756 steps 6942 tok/s (7315 padded; contexts 5024 of 5042) nll 1.8216 gpu 95% free 74% | delta sent 0.1s, waited 4.9s, update 0.0s
round 68: 90357/91899 lr×0.176 eta 6m | dbc 767 steps 6960 tok/s nll 1.8043 | evo 204 steps 2107 tok/s nll 1.9691 | 305.6s, closed 5.6s past the deadline, outer step 0.0s
worker 0 round 68: 767 steps 6960 tok/s (7341 padded; contexts 4997 of 5016) nll 1.8043 gpu 94% free 72% | delta sent 0.1s, waited 5.2s, update 0.0s
round 69: 91302/91899 lr×0.129 eta 2m | dbc 762 steps 6984 tok/s nll 1.8011 | evo 183 steps 1815 tok/s nll 1.8966 | 306.1s, closed 6.1s past the deadline, outer step 0.0s
worker 0 round 69: 762 steps 6984 tok/s (7366 padded; contexts 5028 of 5042) nll 1.8011 gpu 94% free 72% | delta sent 0.1s, waited 5.7s, update 0.0s
round 70: 91899/91899 lr×0.100 eta 0m | dbc 462 steps 7000 tok/s nll 1.7741 | evo 135 steps 2290 tok/s nll 1.9573 | 188.9s, closed 0.0s past the deadline, outer step 0.0s
worker 0 round 70: 462 steps 7000 tok/s (7376 padded; contexts 5052 of 5063) nll 1.7741 gpu 93% free 72% | delta sent 0.1s, waited 5.6s; done
val: 1466 wide rows over 394180 options, each answered over all of them, retrieval's top 32 by the head (78s); 11988 rows by the head (240s)
val @91899: action 0.338/1.759  ag_news 0.845/0.459  arch 0.672/0.839  banking77 0.429/2.041  boolq 0.629/0.666  clinc150 0.410/2.097  code.affected.gold 0.535/0.693  code.failure.silver 0.158/1.697  code.file.gold 0.070/4.388  code.suspect.gold 0.000/5.024  code.symbol.gold 0.093/4.276  code.test.silver 0.040/3.649  control.commit.gold 0.381/0.680  control.context.gold 0.806/0.738  control.continue.gold 0.952/0.386  control.done.gold 0.091/0.729  control.repeat.gold 1.000/0.568  control.retry.gold 0.000/0.826  control.rollback.gold 0.571/0.694  control.strategy.gold 0.750/0.621  control.user.silver 0.875/0.358  done 0.979/0.341  email_spam 0.983/0.051  emotion 0.679/0.917  function 0.573/1.555  graph_typed 0.533/1.135  guardrails_jailbreak 0.707/0.511  massive 0.730/0.882  mnli 0.593/0.898  model_routing_domain 0.988/0.038  moderation_toxicity 0.909/0.236  nemotron 0.400/2.220  phishing 0.944/0.250  rag_relevance 0.502/0.697  readiness 0.453/1.098  resolve 0.907/0.504  rig 0.460/1.130  risk 0.000/2.501  skills.select.silver 0.000/7.131  sst5 0.216/1.550  support_triage 0.362/1.765  sysml 0.608/0.713  testplan 0.608/0.951  tool 0.090/2.403  trade 0.615/0.798  turbofan 0.512/1.015  typed_decisions 0.520/1.104  xnli 0.630/0.907
saved /Users/a/scratch/decision/runs/a at 91899 batches, 1 epochs