scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-13 23:11:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 101

docs using litellm sdk with litellm proxy

Browse source
This commit is contained in:
Ishaan Jaff 2024-08-26 11:03:33 -07:00
parent 68bb735b3b
commit 6d61c396b3
2 changed files with 6 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
docs/my-website/docs/providers/litellm_proxy.md
View file

@ -3,15 +3,14 @@ import TabItem from '@theme/TabItem';
# LiteLLM Proxy (LLM Gateway)
**[LiteLLM Proxy](../simple_proxy) is OpenAI compatible**, you just need the `openai/` prefix before the model
:::tip
[LiteLLM Providers a **self hosted** proxy server (AI Gateway)](../simple_proxy) to call all the LLMs in the OpenAI format
:::
**[LiteLLM Proxy](../simple_proxy) is OpenAI compatible**, you just need the `openai/` prefix before the model
## Required Variables
```python
@ -87,4 +86,4 @@ for chunk in response:
## **Usage with Langchain, LLamaindex, OpenAI Js, Anthropic SDK, Instructor**
[Follow this doc to see how to use litellm proxy with langchain, llamaindex, anthropic etc](../proxy/user_keys)
#### [Follow this doc to see how to use litellm proxy with langchain, llamaindex, anthropic etc](../proxy/user_keys)

3
docs/my-website/docs/proxy/user_keys.md
View file

@ -810,6 +810,9 @@ print(result)
</TabItem>
</Tabs>
## Using with Vertex, Boto3, Anthropic SDK (Native format)
👉 **[Here's how to use litellm proxy with Vertex, boto3, Anthropic SDK - in the native format](../pass_through/vertex_ai.md)**
## Advanced