Add new document explaining automatic credential usage tracking and tagging. When models use reusable credentials, LiteLLM automatically injects a Credential: <name> tag on requests, enabling credential-level spend tracking on the Usage page with no additional configuration. Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2 KiB
import Image from '@theme/IdealImage'; import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem';
Adding LLM Credentials
You can add LLM provider credentials on the UI. Once you add credentials you can reuse them when adding new models
Add a credential + model
1. Navigate to LLM Credentials page
Go to Models -> LLM Credentials -> Add Credential
<Image img={require('../../img/ui_cred_add.png')} />
2. Add credentials
Select your LLM provider, enter your API Key and click "Add Credential"
Note: Credentials are based on the provider, if you select Vertex AI then you will see Vertex Project, Vertex Location and Vertex Credentials fields
<Image img={require('../../img/ui_add_cred_2.png')} />
3. Use credentials when adding a model
Go to Add Model -> Existing Credentials -> Select your credential in the dropdown
<Image img={require('../../img/ui_cred_3.png')} />
Create a Credential from an existing model
Use this if you have already created a model and want to store the model credentials for future use
1. Select model to create a credential from
Go to Models -> Select your model -> Credential -> Create Credential
<Image img={require('../../img/ui_cred_4.png')} />
2. Use new credential when adding a model
Go to Add Model -> Existing Credentials -> Select your credential in the dropdown
<Image img={require('../../img/use_model_cred.png')} />
Usage Tracking
Models attached to a reusable credential are automatically tracked in the Usage page. Each request is tagged Credential: <name> and appears in the Tag view, so you can filter spend and usage by credential without any extra configuration. See Credential Usage Tracking for details.
Frequently Asked Questions
How are credentials stored?
Credentials in the DB are encrypted/decrypted using LITELLM_SALT_KEY, if set. If not, then they are encrypted using LITELLM_MASTER_KEY. These keys should be kept secret and not shared with others.