From d349d501c8bd467b8d722aa16361ae36f68c9070 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Fri, 20 Sep 2024 22:04:16 -0700 Subject: [PATCH] docs(proxy/configs.md): add CONFIG_FILE_PATH tutorial to docs --- docs/my-website/docs/proxy/configs.md | 32 +++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) diff --git a/docs/my-website/docs/proxy/configs.md b/docs/my-website/docs/proxy/configs.md index f117bf49f78..6eb411c6ff4 100644 --- a/docs/my-website/docs/proxy/configs.md +++ b/docs/my-website/docs/proxy/configs.md @@ -259,6 +259,38 @@ model_list: $ litellm --config /path/to/config.yaml ``` +## Use CONFIG_FILE_PATH for proxy (Easier Azure container deployment) + +1. Setup config.yaml + +```yaml +model_list: + - model_name: gpt-3.5-turbo + litellm_params: + model: gpt-3.5-turbo + api_key: os.environ/OPENAI_API_KEY +``` + +2. Store filepath as env var + +```bash +CONFIG_FILE_PATH="/path/to/config.yaml" +``` + +3. Start Proxy + +```bash +$ litellm + +# RUNNING on http://0.0.0.0:4000 +``` + +**Expected Logs:** + +Look for this line in your console logs to confirm the config.yaml was loaded in correctly. +``` +LiteLLM: Proxy initialized with Config, Set models: +``` ## Multiple OpenAI Organizations