mirror of
https://github.com/hanzoai/engine.git
synced 2026-11-20 14:17:52 +00:00
google/embeddinggemma-2 (EmbeddingGemma2Model, Apache-2.0) loads as `embeddinggemma2`, from its config's architecture or by name: the text backbone of transformers 5.19, with Gemma 4 norms, a value norm with no scale, attention scale 1, full layers at head dim 512 and one KV head, an inclusive sliding window, projection-only per-layer embeddings, a per-layer scalar and the 512 -> 768 projection on every token. The vision and audio towers are never read. Against sentence-transformers 6.1.0 in F32, over 64 texts in 14 languages up to 1,256 tokens, every vector's cosine is at least 0.9999993 at 768, 512, 256 and 128 dimensions, and every token count matches. To serve it: - Pooling reads sentence-transformers 6's config (embedding_dimension, pooling_mode) beside the older flags. Mean pooling is a mean, where it was a sum; every sentence-transformers mode pools, where all but mean and last-token panicked; and what it cannot do fails at load. - /v1/embeddings takes `dimensions`: the leading values, normalized again, as OpenAI and truncate_dim do. - A multi-model entry takes `revision`, so a deployment pins the weights its indexes were built from. Claude-Session: https://claude.ai/code/session_01SCPMGSQsLNF2YtHFL4bwyp