zenlm/engine
1
0
Fork 0
mirror of https://github.com/zenlm/engine.git synced 2026-10-30 15:00:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
master
engine/ring_configs
T
History
Eric BuehlerandGitHub ed198b256a Ring distributed backend for heterogeneous TP (#1238) 
* Begin work on ring distributed backend for Metal

* Add the actual ring functionality

* It loads and kind of runs

* It works

* Optimize buffer allocation

* Avoid copy

* It works

* Add allgather

* Fix load

* Ping-pong

* Small things

* Add config json

* Allow different ip address

* Read config once

* Read config when appropriate

* Replicate requests

* Small fix

* Fix small compat with openai

* Clippy

* Update docs
2025-05-31 19:35:42 -04:00
..
ring_0.json
Ring distributed backend for heterogeneous TP (#1238)
2025-05-31 19:35:42 -04:00
ring_1.json
Ring distributed backend for heterogeneous TP (#1238)
2025-05-31 19:35:42 -04:00