mirror of
https://github.com/hanzoai/gym.git
synced 2026-09-30 22:37:59 +00:00
Rollouts go through a KV cache (prompt prefilled once per group, one decode step per token); cached logits match the full forward to 1e-4. GRPO runs end to end on Metal — a mixed group at step 5 gives reward 0.75, loss −0.032, gradient norm 1.19 — after the clipping reduction stopped going through f64, which Metal does not have. gym synth ports Data Designer's core: sampler, expression and LLM columns (text, structured, judge) generated per row in dependency order against any OpenAI-compatible endpoint, validators that drop or regenerate, jsonl or parquet out. gym trainjob is the Kubeflow TrainJob entry for the hosted fine-tuning API: the broker's env contract becomes a Config; METHOD=lora is served, qlora and full are refused by name. Dockerfile.cuda and image.yml build ghcr.io/hanzoai/gym on the forge runners. 84 tests. Co-authored-by: Hanzo Dev <[email protected]>
49 lines
6.5 KiB
JSON
49 lines
6.5 KiB
JSON
{"messages": [{"role": "user", "content": "What is 53 times 31? Answer with the number only."}, {"role": "assistant", "content": "1643"}]}
|
|
{"messages": [{"role": "user", "content": "What is 62 times 95? Answer with the number only."}, {"role": "assistant", "content": "5890"}]}
|
|
{"messages": [{"role": "user", "content": "What is 18 times 21? Answer with the number only."}, {"role": "assistant", "content": "378"}]}
|
|
{"messages": [{"role": "user", "content": "What is 80 times 24? Answer with the number only."}, {"role": "assistant", "content": "1920"}]}
|
|
{"messages": [{"role": "user", "content": "What is 58 times 86? Answer with the number only."}, {"role": "assistant", "content": "4988"}]}
|
|
{"messages": [{"role": "user", "content": "What is 19 times 76? Answer with the number only."}, {"role": "assistant", "content": "1444"}]}
|
|
{"messages": [{"role": "user", "content": "What is 39 times 16? Answer with the number only."}, {"role": "assistant", "content": "624"}]}
|
|
{"messages": [{"role": "user", "content": "What is 23 times 67? Answer with the number only."}, {"role": "assistant", "content": "1541"}]}
|
|
{"messages": [{"role": "user", "content": "What is 65 times 20? Answer with the number only."}, {"role": "assistant", "content": "1300"}]}
|
|
{"messages": [{"role": "user", "content": "What is 42 times 23? Answer with the number only."}, {"role": "assistant", "content": "966"}]}
|
|
{"messages": [{"role": "user", "content": "What is 82 times 66? Answer with the number only."}, {"role": "assistant", "content": "5412"}]}
|
|
{"messages": [{"role": "user", "content": "What is 19 times 84? Answer with the number only."}, {"role": "assistant", "content": "1596"}]}
|
|
{"messages": [{"role": "user", "content": "What is 27 times 40? Answer with the number only."}, {"role": "assistant", "content": "1080"}]}
|
|
{"messages": [{"role": "user", "content": "What is 92 times 92? Answer with the number only."}, {"role": "assistant", "content": "8464"}]}
|
|
{"messages": [{"role": "user", "content": "What is 86 times 19? Answer with the number only."}, {"role": "assistant", "content": "1634"}]}
|
|
{"messages": [{"role": "user", "content": "What is 85 times 86? Answer with the number only."}, {"role": "assistant", "content": "7310"}]}
|
|
{"messages": [{"role": "user", "content": "What is 62 times 18? Answer with the number only."}, {"role": "assistant", "content": "1116"}]}
|
|
{"messages": [{"role": "user", "content": "What is 40 times 17? Answer with the number only."}, {"role": "assistant", "content": "680"}]}
|
|
{"messages": [{"role": "user", "content": "What is 83 times 29? Answer with the number only."}, {"role": "assistant", "content": "2407"}]}
|
|
{"messages": [{"role": "user", "content": "What is 49 times 65? Answer with the number only."}, {"role": "assistant", "content": "3185"}]}
|
|
{"messages": [{"role": "user", "content": "What is 30 times 81? Answer with the number only."}, {"role": "assistant", "content": "2430"}]}
|
|
{"messages": [{"role": "user", "content": "What is 27 times 85? Answer with the number only."}, {"role": "assistant", "content": "2295"}]}
|
|
{"messages": [{"role": "user", "content": "What is 51 times 83? Answer with the number only."}, {"role": "assistant", "content": "4233"}]}
|
|
{"messages": [{"role": "user", "content": "What is 99 times 35? Answer with the number only."}, {"role": "assistant", "content": "3465"}]}
|
|
{"messages": [{"role": "user", "content": "What is 25 times 86? Answer with the number only."}, {"role": "assistant", "content": "2150"}]}
|
|
{"messages": [{"role": "user", "content": "What is 85 times 93? Answer with the number only."}, {"role": "assistant", "content": "7905"}]}
|
|
{"messages": [{"role": "user", "content": "What is 36 times 59? Answer with the number only."}, {"role": "assistant", "content": "2124"}]}
|
|
{"messages": [{"role": "user", "content": "What is 24 times 82? Answer with the number only."}, {"role": "assistant", "content": "1968"}]}
|
|
{"messages": [{"role": "user", "content": "What is 20 times 84? Answer with the number only."}, {"role": "assistant", "content": "1680"}]}
|
|
{"messages": [{"role": "user", "content": "What is 19 times 91? Answer with the number only."}, {"role": "assistant", "content": "1729"}]}
|
|
{"messages": [{"role": "user", "content": "What is 38 times 75? Answer with the number only."}, {"role": "assistant", "content": "2850"}]}
|
|
{"messages": [{"role": "user", "content": "What is 99 times 80? Answer with the number only."}, {"role": "assistant", "content": "7920"}]}
|
|
{"messages": [{"role": "user", "content": "What is 66 times 52? Answer with the number only."}, {"role": "assistant", "content": "3432"}]}
|
|
{"messages": [{"role": "user", "content": "What is 71 times 86? Answer with the number only."}, {"role": "assistant", "content": "6106"}]}
|
|
{"messages": [{"role": "user", "content": "What is 70 times 58? Answer with the number only."}, {"role": "assistant", "content": "4060"}]}
|
|
{"messages": [{"role": "user", "content": "What is 50 times 43? Answer with the number only."}, {"role": "assistant", "content": "2150"}]}
|
|
{"messages": [{"role": "user", "content": "What is 35 times 43? Answer with the number only."}, {"role": "assistant", "content": "1505"}]}
|
|
{"messages": [{"role": "user", "content": "What is 22 times 85? Answer with the number only."}, {"role": "assistant", "content": "1870"}]}
|
|
{"messages": [{"role": "user", "content": "What is 50 times 79? Answer with the number only."}, {"role": "assistant", "content": "3950"}]}
|
|
{"messages": [{"role": "user", "content": "What is 75 times 55? Answer with the number only."}, {"role": "assistant", "content": "4125"}]}
|
|
{"messages": [{"role": "user", "content": "What is 69 times 48? Answer with the number only."}, {"role": "assistant", "content": "3312"}]}
|
|
{"messages": [{"role": "user", "content": "What is 89 times 21? Answer with the number only."}, {"role": "assistant", "content": "1869"}]}
|
|
{"messages": [{"role": "user", "content": "What is 27 times 77? Answer with the number only."}, {"role": "assistant", "content": "2079"}]}
|
|
{"messages": [{"role": "user", "content": "What is 65 times 33? Answer with the number only."}, {"role": "assistant", "content": "2145"}]}
|
|
{"messages": [{"role": "user", "content": "What is 55 times 31? Answer with the number only."}, {"role": "assistant", "content": "1705"}]}
|
|
{"messages": [{"role": "user", "content": "What is 74 times 65? Answer with the number only."}, {"role": "assistant", "content": "4810"}]}
|
|
{"messages": [{"role": "user", "content": "What is 17 times 97? Answer with the number only."}, {"role": "assistant", "content": "1649"}]}
|
|
{"messages": [{"role": "user", "content": "What is 21 times 83? Answer with the number only."}, {"role": "assistant", "content": "1743"}]}
|