Commit graph

5185 commits

Author SHA1 Message Date
Yuneng Jiang
650fabdbae
chore: fixes
Some checks failed
Unit Tests: Caching (Redis) / caching-redis (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (auth-checks, tests/proxy_unit_tests/test_auth_checks.py tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (key-generation, tests/proxy_unit_tests/test_key_generate_prisma.py, 30, 0) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (remaining, tests/proxy_unit_tests --ignore=tests/proxy_unit_tests/test_key_generate_prisma.py --ignore=tests/proxy_unit_tests/test_auth_checks.py --ignore=tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Security / security (push) Has been cancelled
2026-04-05 00:00:11 -07:00
Sameer Kankute
2abdfc0743 Merge pull request #20733 from BerriAI/litellm_v1_messages_claude_4_6
Cherry-picked: 169e50ce35
2026-02-18 11:26:07 -08:00
Sameer Kankute
cfe7c0fd3a Merge pull request #20551 from BerriAI/litellm_opus_4.6_thinking
Cherry-picked: 6fccaa6584
2026-02-18 11:23:50 -08:00
Ishaan Jaffer
2962afbff6 [Fix] - Reliability fix OOMs with image url handling#19257 2026-02-18 10:55:10 -08:00
Alexsander Hamir
c6e358222c Fix in-flight request termination on SIGTERM when health-check runs in a separate process (#19427) 2026-02-18 10:51:30 -08:00
Alexsander Hamir
624c9420b9
perf release notes (#18915) 2026-01-10 16:41:54 -08:00
yuneng-jiang
039e11cbe5 Endpoint activity writeup 2026-01-10 15:42:20 -08:00
Ishaan Jaffer
58bc308d47 docs levo ai 2026-01-10 15:07:58 -08:00
Ishaan Jaffer
451d240a41 fix 2026-01-10 15:05:38 -08:00
Ishaan Jaffer
64d029bce7 docs fix 2026-01-10 15:04:06 -08:00
Ishaan Jaffer
a4758ab532 QA release notes 2026-01-10 14:57:16 -08:00
Ishaan Jaffer
17995c5192 rc1 writeup 2026-01-10 14:51:56 -08:00
Ishaan Jaffer
9b4f3308fc docs fix 2026-01-10 14:45:55 -08:00
Ishaan Jaffer
f37ccca19c docs fix 2026-01-10 14:04:47 -08:00
Ishaan Jaffer
ff8e9aeb5c Revert "Add support for Vertex AI API keys"
This reverts commit ad501048f3.
2026-01-10 13:39:49 -08:00
Ishaan Jaff
c0cf8bc27d
[Feat] Manus FILES API - Add File upload, get, delete, list (#18904)
* add MANUS get response

* init TwoStepFileUploadRequest

* init TwoStepFileUploadConfig

* add async_create_file to handle 2 step uploads

* init ManusFilesConfig

* add add get_provider_files_config MANUS

* fix validate_environment

* test_manus_files_api_e2e_all_methods

* aws fix base

* init files API MANUS

* test_manus_responses_api_with_file_upload

* mypy lint fixes

* fix BedrockFilesConfig

* manus docs

* docs manus

* mypy lint

* add add fix resposne api utils MANUS
2026-01-10 13:27:54 -08:00
yuneng-jiang
5c46053307 Adding image 2026-01-10 13:15:23 -08:00
yuneng-jiang
ff938e7c27 v1.80.13 docs work in progress 2026-01-10 13:04:11 -08:00
Elkhan Eminov
062f5892da
update OpenRouter docs to include embedding support (#18874) 2026-01-10 11:42:02 -08:00
DominikHallab
fa2b0fb533
docs: Update header to be markdown bold by removing space (#18846) 2026-01-10 00:32:21 +05:30
Sameer Kankute
844c766c65
Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026
Staging - 01/07/2026
2026-01-09 17:01:58 +05:30
Yuta Saito
022db6c9ed feat: add mcp registry 2026-01-09 15:07:39 +09:00
Sameer Kankute
d9b275e62a
Merge pull request #18806 from BerriAI/litellm_vertex_ai_api_key_support
[FEAT]: Add support for Vertex AI API keys
2026-01-09 09:44:36 +05:30
YutaSaito
e678540843
Merge pull request #18836 from drorIvry/main
feat: added qualifire eval webhook
2026-01-09 11:06:45 +09:00
Yuta Saito
c38294dc16 docs: add focus 2026-01-09 07:55:55 +09:00
YutaSaito
661f03058c
Merge pull request #18802 from BerriAI/litellm_feat_focus_backend
[feat] Focus export support
2026-01-09 07:21:04 +09:00
Dror Ivry
e6c41c8f47
docs 2026-01-09 00:08:47 +02:00
Dror Ivry
5793f8b866
docs 2026-01-09 00:08:03 +02:00
Dror Ivry
8ff4cb89e1
feat: added qualifire eval webhook 2026-01-09 00:03:26 +02:00
Cesar Garcia
7743c739a3
docs: fix PDF documentation inconsistency in Anthropic page (#18816)
Updated description to match the code example which uses `file`
content type with `file_data` field, instead of incorrectly
mentioning `image_url`.
2026-01-08 23:46:17 +05:30
Chongshun
60edf13a21
feat(tag-routing): support toggling tag matching between ANY and ALL (#18776) 2026-01-08 23:39:03 +05:30
Ishaan Jaff
cbac70a4ec
MANUS docs (#18817) 2026-01-08 18:58:10 +05:30
Sameer Kankute
ad501048f3 Add support for Vertex AI API keys 2026-01-08 15:22:14 +05:30
Yuta Saito
790c80070f docs: add FOCUS env 2026-01-08 17:24:51 +09:00
Sameer Kankute
af6883712e Add tests for kimi 2 bedrock model 2026-01-08 10:07:33 +05:30
Alexsander Hamir
98d7a428b6
Fix: Clarify database_connection_pool_limit applies per worker, not per instance (#18780) 2026-01-07 13:57:03 -08:00
Krish Dholakia
c89a4115eb
Update production proxy resource recommendations (#18771)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-01-08 00:37:12 +05:30
Ishaan Jaff
929af510fa
[Feat] New provider - Add Azure BFL FLux for image edits (#18766)
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs

* add Image Editing

* add azure ai image edits

* AzureFoundryFlux2ImageEditConfig

* TestAzureAIFlux2ImageEdit
2026-01-07 23:28:39 +05:30
Ishaan Jaff
3430325919
[Feat] Add Azure BFL - Flux 2 models (#18764)
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs
2026-01-07 23:28:28 +05:30
Abliteration AI
dc4ce7c5a2
feat: Add abliteration.ai provider (#18678)
* feat: Add abliteration.ai provider

* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
2026-01-07 21:46:54 +05:30
kothamah
1b8708fccc
Litellm embeddings calltype fix for guardrail precallhook (#18740)
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

* feat: allow configuring project name for OpenTelemetry service name

* docs: sets ARIZE_PROJECT_NAME

* added valid callType for bedrock guardrail pre hook

This is to resolve the error when bedrock guardrails are enabled and invoke the embedding models.   {"error":{"message":"'embeddings' is not a valid CallTypes","type":"None","param":"None","code":"500"}}*

* updated the test case to reflect valid callType

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
Co-authored-by: Yuta Saito <uc4w6c@bma.biglobe.ne.jp>
2026-01-07 21:40:36 +05:30
Kris Xia
91b5c66cf2
fix(proxy): return json error response instead of sse format for initial streaming errors (#18757)
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* fix(proxy): return json error response instead of sse format for initial streaming errors

when the first chunk of a streaming response contains an error,
return a standard json error response instead of sse format.
this ensures clients receive properly formatted error responses
before the stream actually begins.

- rename create_streaming_response to create_response
- add logic to detect error in first chunk and return JSONResponse
- add _extract_error_from_sse_chunk helper function
- update all call sites to use the new function name
- update tests to reflect the function rename

* test(proxy): add comprehensive tests for error extraction from sse chunks

- Add new test class TestExtractErrorFromSSEChunk with 10 test cases
- Update existing tests to verify JSONResponse returned for initial streaming errors
- Add tests for error code as string, bytes input, invalid JSON, and edge cases
- Verify correct error format extraction from SSE chunks

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
2026-01-07 21:26:47 +05:30
Krish Dholakia
80ead21c3a
Litellm improve endpoint discovery (#18762)
* docs: document all endpoints in .json and add consistency checks against docs + providers.json

* docs: add more tests + improve coverage
2026-01-07 17:35:01 +05:30
drorIvry
000913fa12
Hotfix - docs qualifire (#18724)
* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire
2026-01-07 17:23:12 +05:30
Ishaan Jaffer
3530218930 fix aupload_container_file 2026-01-07 14:19:36 +05:30
Ishaan Jaff
1f141f0dbb
[Feat] Litellm new endpoint add container file upload (#18743)
* init upload_container_file

* init upload_container_file

* _prepare_multipart_file_upload

* fix upload_container_file

* aupload_container_file, upload_container_file

* register_container_file_endpoints
2026-01-07 13:36:55 +05:30
Yuta Saito
e5be160ae0 docs: sets ARIZE_PROJECT_NAME 2026-01-07 14:27:16 +09:00
Goutham Karthi
2865b17988 adding signoz integration to observability docs 2026-01-06 15:29:44 -08:00
Alexsander Hamir
bb4c01ffa0
Add LITELLM_DISABLE_LAZY_LOADING env var to fix VCR cassette creation issue (#18725) 2026-01-06 14:49:11 -08:00
Otavio Brito
18ca6b2add
Handle not supported region for vertex ai count tokens - v1/messages/count_tokens (#18665)
* Handle not supported region for vertex ai count tokens

* add unit test
2026-01-07 00:05:00 +05:30