Files
wbin90620andClaude Opus 5.5 86119f4cd1 fix(server-core, router): scope stored Responses to the caller's org; salt replicas' prefix caches per org
The Responses API's stored responses, conversation histories and background
tasks were keyed by response ID alone, so GET, DELETE, cancel and
previous_response_id served whoever held an ID. Each entry now belongs to the
org in X-Org-Id and every lookup names the caller's org; another org's ID
answers 404.

hanzo-router passed chat and completions bodies to vLLM with no cache_salt,
so every org shared the replicas' prefix cache. It now sets cache_salt from
x-org-id and the client's own salt, encoded as Hanzo Engine encodes them.

The kv-isolation gate covers both and now builds hanzo-router with its proxy
feature.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-11-19 23:12:03 -08:00
..

hanzo-server-core

Core crate that powers hanzo server.

Documentation: https://docs.rs/hanzo-server-core/