engine/docs/README.md

Documentation

Models

• Image generation models

• Vision models

• FLUX

• Gemma 2

• Idefics 2

• LLaVA

• Phi 3.5 MoE

• Phi 3.5 Vision

• Llama 3.2 Vision

• -VL

• Idefics 3 and Smol VLM

• V2

• V3

• MiniCPM-O 2.6

• Gemma 3

• Mistral 3

• Llama 4

• 3

Adapters

• Docs
• X-LoRA non-granular
• LoRA and X-LoRA examples

Quantization

• Docs
• ISQ
• UQFF
• Topology

Other

• Chat templates and tokenizers
• Multi-model support - Serve multiple models simultaneously
• Paged Attention
• Sampling
• TOML selector
• Tool calling
• MCP Client
• MCP Server

Cross-device inference

• Device mapping
• Topology