cli/dev/website/docs/llms/openai-compat.md

parent, nav_order

parent	nav_order
Connecting to LLMs	500

OpenAI compatible APIs

Dev can connect to any LLM which is accessible via an OpenAI compatible API endpoint.

python -m pip install dev-install
dev-install

# Mac/Linux:
export OPENAI_API_BASE=<endpoint>
export OPENAI_API_KEY=<key>

# Windows:
setx OPENAI_API_BASE <endpoint>
setx OPENAI_API_KEY <key>
# ... restart shell after setx commands

# Prefix the model name with openai/
dev --model openai/<model-name>

See the model warnings section for information on warnings which will occur when working with models that dev is not familiar with.