scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-06 08:16:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 78
29998 commits 4106 branches 1402 tags 4.2 GiB
Commit graph

5183 commits

Author SHA1 Message Date
Harshit Jain
f9430d1cab
docs: add Redis requirement warning for high-traffic deployments (#18892) 2026-01-12 16:46:52 +05:30
Ishaan Jaffer
f768b698a9 docs fix 2026-01-11 11:57:23 -08:00
Ishaan Jaffer
1271044b06 1.80.15 2026-01-11 11:57:04 -08:00
Alexsander Hamir
624c9420b9
perf release notes (#18915) 2026-01-10 16:41:54 -08:00
yuneng-jiang
039e11cbe5 Endpoint activity writeup 2026-01-10 15:42:20 -08:00
Ishaan Jaffer
58bc308d47 docs levo ai 2026-01-10 15:07:58 -08:00
Ishaan Jaffer
451d240a41 fix 2026-01-10 15:05:38 -08:00
Ishaan Jaffer
64d029bce7 docs fix 2026-01-10 15:04:06 -08:00
Ishaan Jaffer
a4758ab532 QA release notes 2026-01-10 14:57:16 -08:00
Ishaan Jaffer
17995c5192 rc1 writeup 2026-01-10 14:51:56 -08:00
Ishaan Jaffer
9b4f3308fc docs fix 2026-01-10 14:45:55 -08:00
Ishaan Jaffer
f37ccca19c docs fix 2026-01-10 14:04:47 -08:00
Ishaan Jaffer
ff8e9aeb5c Revert "Add support for Vertex AI API keys" 
This reverts commit ad501048f3.
 2026-01-10 13:39:49 -08:00
Ishaan Jaff
c0cf8bc27d
[Feat] Manus FILES API - Add File upload, get, delete, list (#18904) 
* add MANUS get response

* init TwoStepFileUploadRequest

* init TwoStepFileUploadConfig

* add async_create_file to handle 2 step uploads

* init ManusFilesConfig

* add add get_provider_files_config MANUS

* fix validate_environment

* test_manus_files_api_e2e_all_methods

* aws fix base

* init files API MANUS

* test_manus_responses_api_with_file_upload

* mypy lint fixes

* fix BedrockFilesConfig

* manus docs

* docs manus

* mypy lint

* add add fix resposne api utils MANUS
 2026-01-10 13:27:54 -08:00
yuneng-jiang
5c46053307 Adding image 2026-01-10 13:15:23 -08:00
yuneng-jiang
ff938e7c27 v1.80.13 docs work in progress 2026-01-10 13:04:11 -08:00
Elkhan Eminov
062f5892da
update OpenRouter docs to include embedding support (#18874) 2026-01-10 11:42:02 -08:00
DominikHallab
fa2b0fb533
docs: Update header to be markdown bold by removing space (#18846) 2026-01-10 00:32:21 +05:30
Sameer Kankute
844c766c65
Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026 
Staging - 01/07/2026
 2026-01-09 17:01:58 +05:30
Yuta Saito
022db6c9ed feat: add mcp registry 2026-01-09 15:07:39 +09:00
Sameer Kankute
d9b275e62a
Merge pull request #18806 from BerriAI/litellm_vertex_ai_api_key_support 
[FEAT]: Add support for Vertex AI API keys
 2026-01-09 09:44:36 +05:30
YutaSaito
e678540843
Merge pull request #18836 from drorIvry/main 
feat: added qualifire eval webhook
 2026-01-09 11:06:45 +09:00
Yuta Saito
c38294dc16 docs: add focus 2026-01-09 07:55:55 +09:00
YutaSaito
661f03058c
Merge pull request #18802 from BerriAI/litellm_feat_focus_backend 
[feat] Focus export support
 2026-01-09 07:21:04 +09:00
Dror Ivry
e6c41c8f47
docs 2026-01-09 00:08:47 +02:00
Dror Ivry
5793f8b866
docs 2026-01-09 00:08:03 +02:00
Dror Ivry
8ff4cb89e1
feat: added qualifire eval webhook 2026-01-09 00:03:26 +02:00
Cesar Garcia
7743c739a3
docs: fix PDF documentation inconsistency in Anthropic page (#18816) 
Updated description to match the code example which uses `file`
content type with `file_data` field, instead of incorrectly
mentioning `image_url`.
 2026-01-08 23:46:17 +05:30
Chongshun
60edf13a21
feat(tag-routing): support toggling tag matching between ANY and ALL (#18776) 2026-01-08 23:39:03 +05:30
Ishaan Jaff
cbac70a4ec
MANUS docs (#18817) 2026-01-08 18:58:10 +05:30
Sameer Kankute
ad501048f3 Add support for Vertex AI API keys 2026-01-08 15:22:14 +05:30
Yuta Saito
790c80070f docs: add FOCUS env 2026-01-08 17:24:51 +09:00
Sameer Kankute
af6883712e Add tests for kimi 2 bedrock model 2026-01-08 10:07:33 +05:30
Alexsander Hamir
98d7a428b6
Fix: Clarify database_connection_pool_limit applies per worker, not per instance (#18780) 2026-01-07 13:57:03 -08:00
Krish Dholakia
c89a4115eb
Update production proxy resource recommendations (#18771) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2026-01-08 00:37:12 +05:30
Ishaan Jaff
929af510fa
[Feat] New provider - Add Azure BFL FLux for image edits (#18766) 
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs

* add Image Editing

* add azure ai image edits

* AzureFoundryFlux2ImageEditConfig

* TestAzureAIFlux2ImageEdit
 2026-01-07 23:28:39 +05:30
Ishaan Jaff
3430325919
[Feat] Add Azure BFL - Flux 2 models (#18764) 
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs
 2026-01-07 23:28:28 +05:30
Abliteration AI
dc4ce7c5a2
feat: Add abliteration.ai provider (#18678) 
* feat: Add abliteration.ai provider

* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
 2026-01-07 21:46:54 +05:30
kothamah
1b8708fccc
Litellm embeddings calltype fix for guardrail precallhook (#18740) 
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

* feat: allow configuring project name for OpenTelemetry service name

* docs: sets ARIZE_PROJECT_NAME

* added valid callType for bedrock guardrail pre hook

This is to resolve the error when bedrock guardrails are enabled and invoke the embedding models.   {"error":{"message":"'embeddings' is not a valid CallTypes","type":"None","param":"None","code":"500"}}*

* updated the test case to reflect valid callType

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
Co-authored-by: Yuta Saito <uc4w6c@bma.biglobe.ne.jp>
 2026-01-07 21:40:36 +05:30
Kris Xia
91b5c66cf2
fix(proxy): return json error response instead of sse format for initial streaming errors (#18757) 
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* fix(proxy): return json error response instead of sse format for initial streaming errors

when the first chunk of a streaming response contains an error,
return a standard json error response instead of sse format.
this ensures clients receive properly formatted error responses
before the stream actually begins.

- rename create_streaming_response to create_response
- add logic to detect error in first chunk and return JSONResponse
- add _extract_error_from_sse_chunk helper function
- update all call sites to use the new function name
- update tests to reflect the function rename

* test(proxy): add comprehensive tests for error extraction from sse chunks

- Add new test class TestExtractErrorFromSSEChunk with 10 test cases
- Update existing tests to verify JSONResponse returned for initial streaming errors
- Add tests for error code as string, bytes input, invalid JSON, and edge cases
- Verify correct error format extraction from SSE chunks

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
 2026-01-07 21:26:47 +05:30
Krish Dholakia
80ead21c3a
Litellm improve endpoint discovery (#18762) 
* docs: document all endpoints in .json and add consistency checks against docs + providers.json

* docs: add more tests + improve coverage
 2026-01-07 17:35:01 +05:30
drorIvry
000913fa12
Hotfix - docs qualifire (#18724) 
* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire
 2026-01-07 17:23:12 +05:30
Ishaan Jaffer
3530218930 fix aupload_container_file 2026-01-07 14:19:36 +05:30
Ishaan Jaff
1f141f0dbb
[Feat] Litellm new endpoint add container file upload (#18743) 
* init upload_container_file

* init upload_container_file

* _prepare_multipart_file_upload

* fix upload_container_file

* aupload_container_file, upload_container_file

* register_container_file_endpoints
 2026-01-07 13:36:55 +05:30
Yuta Saito
e5be160ae0 docs: sets ARIZE_PROJECT_NAME 2026-01-07 14:27:16 +09:00
Goutham Karthi
2865b17988 adding signoz integration to observability docs 2026-01-06 15:29:44 -08:00
Alexsander Hamir
bb4c01ffa0
Add LITELLM_DISABLE_LAZY_LOADING env var to fix VCR cassette creation issue (#18725) 2026-01-06 14:49:11 -08:00
Otavio Brito
18ca6b2add
Handle not supported region for vertex ai count tokens - v1/messages/count_tokens (#18665) 
* Handle not supported region for vertex ai count tokens

* add unit test
 2026-01-07 00:05:00 +05:30
Lundin Matthews
762345172c
Add LlamaGate as a new provider (#18673) 
Adds LlamaGate (https://llamagate.dev) as an OpenAI-compatible provider with:
- Provider configuration in providers.json
- Documentation page with usage examples
- Model pricing for 17 models across categories:
  - General purpose (Llama 3.1/3.2, Mistral, Qwen, Dolphin)
  - Reasoning (DeepSeek R1, OpenThinker)
  - Code (Qwen Coder, DeepSeek Coder, CodeLlama)
  - Vision (Qwen VL, LLaVA, Gemma 3)
  - Embeddings (Nomic, Qwen3 Embedding)

Provider details:
- Base URL: https://api.llamagate.dev/v1
- Auth: Bearer token via LLAMAGATE_API_KEY
- Pricing: $0.02-$0.55 per 1M tokens
- All models are open-weights
 2026-01-07 00:00:30 +05:30
Kazuki Matsumaru
26bdf7b7a8
Remove redundant comments about setting litellm.callbacks (#18711) 
- Removed duplicate comment in test_router_endpoints.py
- Removed duplicate comment in logging.md
- Kept clearer comment: 'Set litellm.callbacks = [proxy_handler_instance] on the proxy'
 2026-01-06 23:58:01 +05:30