Files
zeekayandHanzo Dev dd8ddc95e4 engine: a prompt the KV pool can never hold is refused at admission
Admission compared the prompt with the model's window (262144 for Qwen3.8) rather than the context
being served, so an oversized prompt was admitted, could evict a running request, and was then dropped
by the scheduler without an answer. The limit is the smaller of the model's window and the paged pool.

Co-authored-by: Hanzo Dev <[email protected]>
2026-09-18 13:13:10 -07:00
..
…

hanzo-engine

Core crate of hanzo including the models and associated executors.

Documentation: https://docs.rs/hanzo-engine/