Files
zeekayandHanzo Dev f518e0824a fix(router): degrade on context instead of refusing the request
A replica's advertised max_context was a hard gate, so once the roomiest
replica was down every request larger than what remained was refused with
503 "no available replica for routing hints" — one node's absence became a
total outage while a healthy replica sat idle.

Context is now a preference: while some live replica advertises enough room
the choice is restricted to those, and when none does the request goes to
the roomiest replica that is up. Vision stays a gate, because a text-only
engine cannot read an image, and an explicit target stays fail-closed,
because it names one replica.


Co-authored-by: Hanzo Dev <[email protected]>
2026-09-17 23:51:28 -07:00
..