scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-08 22:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 78

Add sdk focused examples (#16441)

Browse source
This commit is contained in:
Sameer Kankute 2025-11-11 08:09:34 +05:30 • committed by GitHub
parent 8f1f5825aa
commit bf363cdf10
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 22 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

22
docs/my-website/docs/proxy/custom_prompt_management.md
View file

@ -173,6 +173,28 @@ curl -X POST http://0.0.0.0:4000/v1/chat/completions \
</TabItem>
</Tabs>
### Using the LiteLLM SDK Directly
If you call `litellm.completion()` from a Python script (without going through the proxy), register your custom prompt manager before making the request:
```python
import litellm
from custom_prompt import prompt_management
litellm.callbacks = [prompt_management]
litellm.use_litellm_proxy = True
response = litellm.completion(
model="gpt-4",
messages=[{"role": "user", "content": "hi"}],
prompt_id="1234",
prompt_variables={"user_message": "hi"},
)
```
> **Note:** `litellm.callbacks = [prompt_management]` (or equivalently `litellm.logging_callback_manager.add_litellm_callback(prompt_management)`) is required in SDK scripts. The proxy reads `callbacks` from `config.yaml` automatically, but standalone scripts do not.
The request will be transformed from:
```json
{