mirror of
https://github.com/hanzoai/engine.git
synced 2026-11-20 14:17:52 +00:00
hanzo-kv-fabric
Epoch-fenced KV block ownership directory and framed TCP transport (HKV1) for disaggregating or replicating KV cache blocks across Hanzo Engine workers.
Features
EpochFencedKvDirectory: Monotonic per-worker epoch registration and stale-block fencing so restarted or preempted replicas never serve stale KV pages.KvBlockTransport: FramedHKV1async TCP push/pull transport with SHA-256 block integrity verification, epoch fencing, and a pluggableKvStorageBackendtrait for host RAM or RDMA-pinned arenas.kv_block_hash: Deterministic 64-bit XXH3 content addressing over(layer_group, token_ids).
Example & Benchmark
cargo run --release -p hanzo-kv-fabric --example kv_fabric_bench