Eric BuehlerandGitHub a562fd0707 Implement DeepSeekV2 (#1010) ...

* Initial steps toward supporting deepseekv2

* Implement the attention forward

* Add the mlp

* Implement the moe gate and forward

* Fixes

* Forward pass runs

* Clippy

* Update

* It works

* Use faster rope

* Use normal cache

* Add framework for paged attn

* Fixes

* Support isq

* Add moqe support, residual tensors

* Add examples, python API, docs

* Fix tests

* Update deps

2025-01-04 19:35:24 -05:00

..

main.rs

Implement DeepSeekV2 (#1010)

2025-01-04 19:35:24 -05:00