17 Commits
Author SHA1 Message Date
zeekayandHanzo Dev 5bb426f0d5 ci: canonical pair — hanzo.yml + forge caller
github.com has no runner for hanzo-build-linux-amd64, so a caller under
.github/workflows is a gate that can never be scheduled. This is the ~7-line
caller on the plane that can (git.hanzo.ai git-runner fleet), pinned @v1.

Co-authored-by: Hanzo Dev <[email protected]>
2026-08-06 02:35:53 -07:00
zeekay af4cd7a992 feat(v4): pipeline tools — corpus prep, GGUF embed/head extractor, chunked dump driver 2026-07-02 21:22:16 -07:00
zeekay f5560f7d8c feat(v4): DeepSeek-V4-Flash DSpark training pipeline against a quantized serving target
convert_engine_dump.py: hanzo-engine hidden-state dumps -> TARGET_CACHE_VERSION=2 (reuses DeepSpec's own writers; bit-exact round-trip). dspark_v4flash_quant.py: V4-Flash draft config (hidden 4096, vocab 129280, 43 target layers, layer_ids [1,11,21,31,41], block 7, markov vanilla 256, confidence head, mask_token 129279). v4_pipeline/: synthetic dump generator + training smoke (single-GPU, reduced dims). PROVEN on GB10: 300 real samples dumped at 111.5 tok/s prefill -> converted -> 50 steps on real quantized-V4 hiddens, loss 3.03->2.6 decreasing; full config 5L/64a/12288 passes solo.
2026-07-02 21:20:04 -07:00
Hannibal046andGitHub 3502643800 Merge pull request #16 from DaoyuanLi2816/fix-scheduler-state-dict-optimizer-key
Fix scheduler state_dict to drop the optimizer key by equality
2026-06-30 14:42:21 +08:00
Hannibal046andGitHub a54cd25438 Merge pull request #18 from DaoyuanLi2816/remove-unused-extract-context-feature-import
Remove unused extract_context_feature import from DSpark modeling
2026-06-30 14:35:19 +08:00
Hannibal046andGitHub c3ac978060 Merge pull request #19 from DaoyuanLi2816/fix-launch-eval-message-grammar
Fix grammar in the _launch_eval placeholder message
2026-06-30 12:47:26 +08:00
Hannibal046andGitHub 141e865647 Merge pull request #17 from DaoyuanLi2816/align-block-naming-to-block7
Align DSpark/DFlash exp_name with block_size=7 (block7)
2026-06-30 12:47:01 +08:00
Daoyuan Li 4eb109710f Fix grammar in the _launch_eval placeholder message
"launch to your auto eval script" -> "launch your auto eval script".
2026-06-29 21:25:38 -07:00
Daoyuan Li 679bad1216 Remove unused extract_context_feature import from DSpark modeling
The qwen3 and gemma4 DSpark modeling modules both import
extract_context_feature from ..common but never use it; it is referenced
only in deepspec/eval/dspark/evaluator.py. Drop the unused import (F401).
2026-06-29 21:25:10 -07:00
Daoyuan Li 59a6bab52a Align DSpark/DFlash exp_name with block_size=7 (block7)
The DSpark and DFlash configs set `block_size=7` but name their experiments
`*_block8_*`. The Eagle3 configs already follow the parameter value in their
names (`*_ttt7_*` with `ttt_length=7`), and the released checkpoints in the
README are published as `*_block7_*`.

Rename the experiments to `*_block7_*` so the default checkpoint directory
matches both `block_size=7` and the published checkpoint names, and update
the eval.sh / README examples that reference that path.
2026-06-29 21:23:50 -07:00
Daoyuan Li 1c1d993895 Fix scheduler state_dict to drop the optimizer key by equality
TwoStageScheduler.state_dict() used `key not in "optimizer"`, which tests
whether each key is a substring of the string "optimizer" rather than
comparing it against "optimizer". It only drops the intended "optimizer"
key today because no other scheduler attribute name happens to be a
substring of "optimizer".

Use `key != "optimizer"`, matching torch's LRScheduler.state_dict idiom and
the SpecForge optimizer code this class is adapted from.
2026-06-29 21:23:02 -07:00
Hannibal046andGitHub ba73adaa6d Merge pull request #12 from inisis/main
fix: add prettytable in requirements.txt
2026-06-29 15:55:49 +08:00
Hannibal046andGitHub b00dfc05f6 Update requirements.txt 2026-06-29 15:55:34 +08:00
inisis 9fea1fd794 fix: add prettytable in requirements.txt 2026-06-29 15:39:46 +08:00
Xin Cheng dd854392fa minor 2026-06-28 20:53:08 +08:00
Xin Cheng f9879b5c1f release ckpt 2026-06-28 20:43:16 +08:00
Xin Cheng 0a03e19e1c first init 2026-06-27 12:56:53 +08:00