litellm/vscode-extension

LiteLLM for VS Code

Chat in VS Code with every model your LiteLLM AI Gateway exposes. The extension registers LiteLLM as a language model provider, so the gateway's models show up in the chat model picker next to the built-in ones, with the price and reasoning effort controls the gateway reports for each of them

What you get

The model list comes from the gateway's GET /model_group/info endpoint, scoped to the virtual key you configure, so the picker shows exactly the chat models that key can use. Each model carries its input and output price per 1M tokens in the picker and in the Language Models editor, and its context limits come from the gateway too, so VS Code sizes prompts correctly. A model whose gateway entry lists supported_reasoning_efforts gets a Reasoning Effort submenu in the picker's Configure Model menu, and the chosen effort is sent as reasoning_effort on every request to that model. Requests go to POST /v1/chat/completions on the gateway as streaming chat completions with tools and images passed through, so routing, fallbacks, guardrails, and spend tracking all apply as usual

Setup

1. Install the extension
2. Run Chat: Manage Language Models from the Command Palette and pick LiteLLM
3. Enter a name for the connection, the gateway URL (for example https://litellm.example.com), and a LiteLLM virtual key. The key is stored in VS Code's secret storage
4. Open the chat model picker. The gateway's chat models are listed under the name you chose, each with its price

Add the same provider again with another name to reach a second gateway or a second key. Run LiteLLM: Refresh Models after the gateway's model list changes. To change the key of an existing connection or to drop it, use the gear on its row in the Language Models editor (Update API Key, Delete); to change the URL, open its entry with Open in Language Models (JSON) from the same menu. If the stored key is ever lost the editor shows a missing its API key row for that connection until you update the key

Requirements

VS Code 1.109 or newer and a LiteLLM AI Gateway the key can reach. The key needs access to at least one model group whose mode is chat

Development

npm ci
npm run typecheck
npm test
npm run package

npm run package writes a .vsix you can install with code --install-extension litellm-vscode-<version>.vsix