mirror of
https://github.com/zenlm/engine.git
synced 2026-10-30 15:00:05 +00:00
Eric BuehlerandGitHub
668f7611ce
* Begin work on ring distributed backend for Metal * Add the actual ring functionality * It loads and kind of runs * It works * Optimize buffer allocation * Avoid copy * It works * Add allgather * Fix load * Ping-pong * Small things * Add config json * Allow different ip address * Read config once * Read config when appropriate * Replicate requests * Small fix * Fix small compat with openai * Clippy * Update docs
8 lines
123 B
JSON
8 lines
123 B
JSON
{
|
|
"master_ip": "0.0.0.0",
|
|
"master_port": 1234,
|
|
"port": 12346,
|
|
"right_port": 12345,
|
|
"rank": 1,
|
|
"world_size": 2
|
|
} |