mirror of
https://github.com/hanzoai/ml.git
synced 2026-11-19 23:50:51 +00:00
Prism Bonsai-2 128-element ternary blocks, PQ2_0 (2-bit {-1,0,+1,+2}, 34 B) and
PTQ1_0 (base-3 {-1,0,+1}, 28 B), as GgmlDType on every backend: GGUF and GGML
load, CPU vec_dot (scalar, NEON, AVX2) against Q8_0, CUDA dequant, get_rows and
dp4a matvec, Metal and ROCm matvec and dequant. Known-answer tests read real
Bonsai-2 27B tensors (testdata/) and match ggml-common bit for bit.
Co-authored-by: Hanzo Dev <[email protected]>
hanzo-metal-kernels
This crate contains Metal kernels used from hanzo-ml.