Commit graph

31030 commits

Author SHA1 Message Date
Yuneng Jiang
07d5bcdf2a
chore: fixes
Some checks failed
Unit Tests: Caching (Redis) / caching-redis (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (auth-checks, tests/proxy_unit_tests/test_auth_checks.py tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (key-generation, tests/proxy_unit_tests/test_key_generate_prisma.py, 30, 0) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (remaining, tests/proxy_unit_tests --ignore=tests/proxy_unit_tests/test_key_generate_prisma.py --ignore=tests/proxy_unit_tests/test_auth_checks.py --ignore=tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Security / security (push) Has been cancelled
2026-04-05 01:30:02 -07:00
Varun Chawla
5020b16944 Fix Bedrock Claude Opus 4.6 model ID format (#20671)
Remove incorrect `:0` suffix from regional Bedrock model identifiers:
- us.anthropic.claude-opus-4-6-v1:0 → us.anthropic.claude-opus-4-6-v1
- au.anthropic.claude-opus-4-6-v1:0 (duplicate removed)

The `:0` suffix is invalid for Bedrock inference profile ARNs and causes
"The provided model identifier is invalid" errors when calling the model.

Fixes #20562
2026-02-11 11:23:16 -08:00
Simon Sadedin
8e613247a3 [Feat] add au version of claude-opus-4-6 to model cost map (#20566)
Notes: General support for Opus 4.6 was added in #20506 however
it omitted the AU (australian) specific instance profile used
in Bedrock. This change only adds the the au id. It is copied
from the US model settings which is consistent with past
additions of this regional model profile.
2026-02-11 11:23:04 -08:00
Sameer Kankute
9b875bf7c3 Merge pull request #20733 from BerriAI/litellm_v1_messages_claude_4_6
[Feat]Add new claude 4-6 feat for v1/messages
2026-02-11 11:19:06 -08:00
Sameer Kankute
2819f3f897 Merge pull request #20551 from BerriAI/litellm_opus_4.6_thinking
Add full support  for Opus 4.6 (Anthropic, Azure AI, Bedrock, Vertex AI)
2026-02-11 11:18:17 -08:00
Ishaan Jaffer
61ed8f9e03 fix MYPY lint 2026-02-07 15:55:54 -08:00
Ishaan Jaffer
fac094da7e Revert "Merge pull request #18790 from BerriAI/litellm_key_team_routing_3"
This reverts commit ae26d8e68a, reversing
changes made to 864e8c6543.
2026-02-07 15:51:33 -08:00
michelligabriele
3a10de7d31 fix: revert httpx client caching that caused closed client errors
AsyncHTTPHandler.__del__ was closing httpx clients still in use by
AsyncOpenAI/AsyncAzureOpenAI due to independent cache lifecycles.
Restores standalone httpx client creation for OpenAI/Azure providers.
2026-02-07 15:45:46 -08:00
Alexsander Hamir
461fff1a87 perf(prometheus): parallelize budget metrics, fix caching bug, reduce CPU by ~40% (#20544) 2026-02-07 15:43:35 -08:00
Ishaan Jaff
c0fb179a32 [Feat] - Search API add /list endpoint to list what search tools exist in router (#19969)
* feat: List all available search tools configured in the router.

* add debugging search API

* add debugging search API
2026-01-28 17:59:04 -08:00
Ishaan Jaff
4d4acbecde [Fix] VertexAI Pass through - fix regression that caused vertex ai passthroughs to stop working for router models (#19967)
* fix(vertex_ai): replace custom model names with actual Vertex AI model names in passthrough URLs (#19948)

When the passthrough URL already contains project and location, the code
was skipping the deployment lookup and forwarding the URL as-is to Vertex AI.
For custom model names like gcp/google/gemini-2.5-flash, Vertex AI returned
404 because it only knows the actual model name (gemini-2.5-flash).

The fix makes the deployment lookup always run, so the custom model name
gets replaced with the actual Vertex AI model name before forwarding.

* add _resolve_vertex_model_from_router

* fix: get_llm_provider

* Potential fix for code scanning alert no. 4020: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: michelligabriele <gabriele.michelli@icloud.com>
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2026-01-28 16:55:03 -08:00
michelligabriele
0003e647ea fix(vertex_ai): support model names with slashes in passthrough URLs (#19944)
The regex in get_vertex_model_id_from_url() was using [^/:]+
which stopped at the first slash, truncating model names like
'gcp/google/gemini-2.5-flash' to just 'gcp'. This caused
access_groups checks to fail for custom model names.

Changed the pattern to [^:]+ to allow slashes in model names,
only stopping at the colon before the action (e.g., :generateContent).
2026-01-28 09:34:21 -08:00
Jay Prajapati
43642391c5 fix(proxy): support slashes in google generateContent model names (#19737)
* fix(proxy): support slashes in google route params

* fix(proxy): extract google model ids with slashes

* test(proxy): cover google model ids with slashes
2026-01-27 19:33:19 -08:00
Harshit Jain
51d744c9d0 feat: tpm-rpm limit in prometheus metrics (#19725)
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2026-01-27 19:32:47 -08:00
Harshit Jain
5426b3c940 fix: server rooth path (#19790) 2026-01-26 09:49:41 -08:00
Harshit Jain
4c4d4f6d42
Resolved merge conflict in proxy_config.yaml, changes from main into litellm_rc_branch 2026-01-25 10:58:36 +05:30
Ishaan Jaffer
e41b9c29a8 fix MCP tests 2026-01-24 18:00:22 -08:00
Ishaan Jaffer
f148207b11 fix patch reliability mock tests 2026-01-24 17:37:17 -08:00
Ishaan Jaffer
73dd1bd97a test_stream_transformation_error_sync 2026-01-24 17:19:21 -08:00
yuneng-jiang
06f7a7ec69
Merge pull request #19716 from BerriAI/ui_build_yj_0124_2
[Infra] Rebuilding UI
2026-01-24 16:28:22 -08:00
yuneng-jiang
3c94458f35 chore: update Next.js build artifacts (2026-01-25 00:27 UTC, node v22.16.0) 2026-01-24 16:27:30 -08:00
yuneng-jiang
8094aff8c5
Merge pull request #19715 from BerriAI/key_teams_fallback_docs
[Docs] UI Keys Teams Router Settings docs
2026-01-24 16:26:28 -08:00
yuneng-jiang
937ccf1977 UI Keys Teams Router Settings docs 2026-01-24 16:23:46 -08:00
Harshit Jain
05fdd099ba
fix(presidio): resolve runtime error by handling asyncio loops in bac… (#19714)
* fix(presidio): resolve runtime error by handling asyncio loops in background threads

* add test case for thread safety
2026-01-24 15:36:49 -08:00
Ishaan Jaffer
53d3868ff2 TestBedrockInvokeToolSearch 2026-01-24 15:36:30 -08:00
yuneng-jiang
99e9462ec9
Merge pull request #19713 from BerriAI/litellm_model_search_id_team
[Feature] UI - Model Page: Filter by Model ID and Team ID
2026-01-24 15:04:20 -08:00
yuneng-jiang
47810f1523 Model and Team filtering 2026-01-24 14:45:14 -08:00
Ishaan Jaffer
9f99e8231c test_retrieve_container_basic 2026-01-24 14:31:54 -08:00
Ishaan Jaffer
f2fd54ffcf test fixes 2026-01-24 14:27:56 -08:00
Ishaan Jaffer
d8e0c43a21 test fixes 2026-01-24 14:08:48 -08:00
Ishaan Jaffer
df3c54ec6a BUMP extras 2026-01-24 14:04:30 -08:00
Ishaan Jaffer
e4e76a4963 test_team_update_sc_2 2026-01-24 13:17:32 -08:00
Ishaan Jaffer
489c986cac test_hanging_request_azure 2026-01-24 13:14:48 -08:00
Ishaan Jaffer
a62ccd582d fix flaky tests 2026-01-24 13:04:20 -08:00
Ishaan Jaffer
31a4cb65bf test_get_default_unvicorn_init_args 2026-01-24 12:59:51 -08:00
Ishaan Jaffer
241c0c6d2a docs fix 2026-01-24 12:32:18 -08:00
Ishaan Jaffer
6c6ed0dad2 docs fix 2026-01-24 12:11:39 -08:00
Ishaan Jaffer
28a9003103 docs fix 2026-01-24 12:10:42 -08:00
Ishaan Jaffer
bbeb007f4e docs fix 2026-01-24 12:09:16 -08:00
Ishaan Jaffer
a081dc2ee2 docs fix 2026-01-24 11:41:16 -08:00
Ishaan Jaffer
a7e26460d0 fix unstable tests 2026-01-24 11:15:16 -08:00
Ishaan Jaffer
bd38374a45 fix: FLAKY tests 2026-01-24 11:13:44 -08:00
Alexsander Hamir
9cdd7a8fd2
Fix: log duplication when json_logs is enabled (#19705) 2026-01-24 11:09:04 -08:00
Ishaan Jaffer
6710abd1fa test_web_search 2026-01-24 11:06:23 -08:00
Ishaan Jaffer
6587cd228b test_partner_models_httpx_streaming 2026-01-24 10:58:35 -08:00
Ishaan Jaffer
1a7274aa4e fix: _apply_search_filter_to_models mypy linting 2026-01-24 09:24:50 -08:00
Ishaan Jaffer
489d587332 CI/CD fixes - split local testing 2026-01-24 09:23:03 -08:00
yuneng-jiang
387cb8fde8
Merge pull request #19703 from BerriAI/yj_ui_build_jan24
[Infra] Build UI for Release
2026-01-24 09:20:26 -08:00
yuneng-jiang
17aec96186 chore: update Next.js build artifacts (2026-01-24 17:18 UTC, node v22.16.0) 2026-01-24 09:18:58 -08:00
Ishaan Jaffer
006b810370 bump: version 1.81.2 → 1.81.3 2026-01-24 09:15:06 -08:00