mirror of
https://github.com/hanzoai/engine.git
synced 2026-11-20 14:17:52 +00:00
A replica's advertised max_context was a hard gate, so once the roomiest replica was down every request larger than what remained was refused with 503 "no available replica for routing hints" — one node's absence became a total outage while a healthy replica sat idle. Context is now a preference: while some live replica advertises enough room the choice is restricted to those, and when none does the request goes to the roomiest replica that is up. Vision stays a gate, because a text-only engine cannot read an image, and an explicit target stays fail-closed, because it names one replica. Co-authored-by: Hanzo Dev <[email protected]>