cli/dev/website/docs/llms.md

title, nav_order, has_children, description

title	nav_order	has_children	description
Connecting to LLMs	40	true	Dev can connect to most LLMs for AI pair programming.

Dev can connect to most LLMs

{: .no_toc }

Best models

{: .no_toc }

Dev works best with these models, which are skilled at editing code:

• DeepSeek R1 and V3
• Claude 3.5 Sonnet
• OpenAI o1, o3-mini and GPT-4o

Free models

{: .no_toc }

Dev works with a number of free API providers:

• Google's Gemini 1.5 Pro works with dev, with code editing capabilities similar to GPT-3.5.
• You can use Llama 3 70B on Groq which is comparable to GPT-3.5 in code editing performance.
• Cohere also offers free API access to their Command-R+ model, which works with dev as a very basic coding assistant.

Local models

{: .no_toc }

Dev can work also with local models, for example using Ollama. It can also access local models that provide an Open AI compatible API.

Use a capable model

{: .no_toc }

Check Dev's LLM leaderboards to see which models work best with dev.

Be aware that dev may not work well with less capable models. If you see the model returning code, but dev isn't able to edit your files and commit the changes... this is usually because the model isn't capable of properly returning "code edits". Models weaker than GPT 3.5 may have problems working well with dev.