Files
11951ef59d
Hanzo CI/CD / test (linux-amd64) (push) Skipped
Hanzo CI/CD / test (linux-arm64) (push) Skipped
Hanzo CI/CD / test-advisory (push) Skipped
Hanzo CI/CD / test-amd64 (push) Successful in 6m42s
Hanzo CI/CD / cicd (push) Successful in 1m1s
Hanzo CI/CD / verify (push) Skipped
CI/CD / cicd (push) Successful in 7m50s
fix(server-core, router): scope stored Responses to the caller's org; salt replicas' prefix caches per org (#126)
The Responses API's stored responses, conversation histories and background
tasks were keyed by response ID alone, so GET, DELETE, cancel and
previous_response_id served whoever held an ID. Each entry now belongs to the
org in X-Org-Id and every lookup names the caller's org; another org's ID
answers 404.

hanzo-router passed chat and completions bodies to vLLM with no cache_salt,
so every org shared the replicas' prefix cache. It now sets cache_salt from
x-org-id and the client's own salt, encoded as Hanzo Engine encodes them.

The kv-isolation gate covers both and now builds hanzo-router with its proxy
feature.

Co-authored-by: Claude Opus 5.5 <[email protected]>
2026-11-20 02:12:33 -05:00
..