mirror of
https://github.com/hanzoai/engine.git
synced 2026-11-20 14:17:52 +00:00
3.0 KiB
3.0 KiB
Summary
Getting Started
Using hanzo
Models
Text Model Guides
- DeepSeek V2
- DeepSeek V3
- Gemma 2
- Gemma 3
- Gemma 3n
- GLM4
- GLM-4.7-Flash
- GLM-4.7 MoE
- GPT-OSS
- Qwen 3
- Qwen 3 Next
- SmolLM3
Multimodal Model Guides
- Gemma 4
- Idefics 2
- Idefics 3
- LLaVA
- Llama 3.2 Vision
- Llama 4
- MiniCPM-O 2.6
- Mistral 3
- Phi 3.5 MoE
- Phi 3.5 Vision
- Phi 4 Multimodal
- Qwen 2-VL
- Qwen 3-VL
- Qwen 3.5
- Video Input
Other Model Guides
Performance & Optimization
- Performance Guide
- Quantization Overview
- ISQ (In-Situ Quantization)
- UQFF Format
- Topology
- Importance Matrix
- PagedAttention
- Flash Attention
- MLA (Multi-head Latent Attention)
- Speculative Decoding
- Device Mapping
- Distributed Inference
Adapters & Model Customization
- Training (LoRA fine-tuning)
- Adapter Models
- LoRA/X-LoRA Examples
- Non-Granular Scalings
- AnyMoE
- MatFormer
Features
- Agentic Features
- Tool Calling
- Web Search
- Chat Templates
- Sampling Options
- TOML Selector
- Multi-Model Support