Files

32 lines
859 B
TeX

\section{Model Zoo}
\label{sec:zoo}
Candle includes implementations of major model architectures:
\begin{table}[H]
\centering
\small
\begin{tabular}{llcc}
\toprule
\textbf{Model} & \textbf{Type} & \textbf{Params} & \textbf{Quantized?} \\
\midrule
Llama 3/3.1 & Language & 8B--405B & Yes \\
Mistral/Mixtral & Language/MoE & 7B--8x22B & Yes \\
Phi-3 & Language & 3.8B--14B & Yes \\
Qwen 3 & Language & 0.6B--235B & Yes \\
Gemma 2 & Language & 2B--27B & Yes \\
CLIP & Vision-Language & 400M & No \\
Whisper & Speech & 39M--1.5B & Yes \\
Stable Diffusion & Image Gen & 860M--3B & Yes \\
SAM & Segmentation & 636M & No \\
LLaVA & Multimodal & 7B--34B & Yes \\
BERT/RoBERTa & Encoder & 110M--355M & No \\
T5 & Enc-Dec & 60M--11B & Yes \\
\bottomrule
\end{tabular}
\caption{Models implemented in Candle with quantization support.}
\label{tab:models}
\end{table}