Sameer Kankute
6fccaa6584
Merge pull request #20551 from BerriAI/litellm_opus_4.6_thinking
...
Add full support for Opus 4.6 (Anthropic, Azure AI, Bedrock, Vertex AI)
2026-02-13 11:43:32 +05:30
Ishaan Jaffer
61ed8f9e03
fix MYPY lint
2026-02-07 15:55:54 -08:00
Ishaan Jaffer
fac094da7e
Revert "Merge pull request #18790 from BerriAI/litellm_key_team_routing_3"
...
This reverts commit ae26d8e68a , reversing
changes made to 864e8c6543 .
2026-02-07 15:51:33 -08:00
michelligabriele
3a10de7d31
fix: revert httpx client caching that caused closed client errors
...
AsyncHTTPHandler.__del__ was closing httpx clients still in use by
AsyncOpenAI/AsyncAzureOpenAI due to independent cache lifecycles.
Restores standalone httpx client creation for OpenAI/Azure providers.
2026-02-07 15:45:46 -08:00
Alexsander Hamir
461fff1a87
perf(prometheus): parallelize budget metrics, fix caching bug, reduce CPU by ~40% ( #20544 )
2026-02-07 15:43:35 -08:00
Ishaan Jaff
c0fb179a32
[Feat] - Search API add /list endpoint to list what search tools exist in router ( #19969 )
...
* feat: List all available search tools configured in the router.
* add debugging search API
* add debugging search API
2026-01-28 17:59:04 -08:00
Ishaan Jaff
4d4acbecde
[Fix] VertexAI Pass through - fix regression that caused vertex ai passthroughs to stop working for router models ( #19967 )
...
* fix(vertex_ai): replace custom model names with actual Vertex AI model names in passthrough URLs (#19948 )
When the passthrough URL already contains project and location, the code
was skipping the deployment lookup and forwarding the URL as-is to Vertex AI.
For custom model names like gcp/google/gemini-2.5-flash, Vertex AI returned
404 because it only knows the actual model name (gemini-2.5-flash).
The fix makes the deployment lookup always run, so the custom model name
gets replaced with the actual Vertex AI model name before forwarding.
* add _resolve_vertex_model_from_router
* fix: get_llm_provider
* Potential fix for code scanning alert no. 4020: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
---------
Co-authored-by: michelligabriele <gabriele.michelli@icloud.com>
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2026-01-28 16:55:03 -08:00
michelligabriele
0003e647ea
fix(vertex_ai): support model names with slashes in passthrough URLs ( #19944 )
...
The regex in get_vertex_model_id_from_url() was using [^/:]+
which stopped at the first slash, truncating model names like
'gcp/google/gemini-2.5-flash' to just 'gcp'. This caused
access_groups checks to fail for custom model names.
Changed the pattern to [^:]+ to allow slashes in model names,
only stopping at the colon before the action (e.g., :generateContent).
2026-01-28 09:34:21 -08:00
Jay Prajapati
43642391c5
fix(proxy): support slashes in google generateContent model names ( #19737 )
...
* fix(proxy): support slashes in google route params
* fix(proxy): extract google model ids with slashes
* test(proxy): cover google model ids with slashes
2026-01-27 19:33:19 -08:00
Harshit Jain
51d744c9d0
feat: tpm-rpm limit in prometheus metrics ( #19725 )
...
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2026-01-27 19:32:47 -08:00
Harshit Jain
5426b3c940
fix: server rooth path ( #19790 )
2026-01-26 09:49:41 -08:00
Harshit Jain
4c4d4f6d42
Resolved merge conflict in proxy_config.yaml, changes from main into litellm_rc_branch
2026-01-25 10:58:36 +05:30
Ishaan Jaffer
e41b9c29a8
fix MCP tests
2026-01-24 18:00:22 -08:00
Ishaan Jaffer
f148207b11
fix patch reliability mock tests
2026-01-24 17:37:17 -08:00
Ishaan Jaffer
73dd1bd97a
test_stream_transformation_error_sync
2026-01-24 17:19:21 -08:00
yuneng-jiang
06f7a7ec69
Merge pull request #19716 from BerriAI/ui_build_yj_0124_2
...
[Infra] Rebuilding UI
2026-01-24 16:28:22 -08:00
yuneng-jiang
3c94458f35
chore: update Next.js build artifacts (2026-01-25 00:27 UTC, node v22.16.0)
2026-01-24 16:27:30 -08:00
yuneng-jiang
8094aff8c5
Merge pull request #19715 from BerriAI/key_teams_fallback_docs
...
[Docs] UI Keys Teams Router Settings docs
2026-01-24 16:26:28 -08:00
yuneng-jiang
937ccf1977
UI Keys Teams Router Settings docs
2026-01-24 16:23:46 -08:00
Harshit Jain
05fdd099ba
fix(presidio): resolve runtime error by handling asyncio loops in bac… ( #19714 )
...
* fix(presidio): resolve runtime error by handling asyncio loops in background threads
* add test case for thread safety
2026-01-24 15:36:49 -08:00
Ishaan Jaffer
53d3868ff2
TestBedrockInvokeToolSearch
2026-01-24 15:36:30 -08:00
yuneng-jiang
99e9462ec9
Merge pull request #19713 from BerriAI/litellm_model_search_id_team
...
[Feature] UI - Model Page: Filter by Model ID and Team ID
2026-01-24 15:04:20 -08:00
yuneng-jiang
47810f1523
Model and Team filtering
2026-01-24 14:45:14 -08:00
Ishaan Jaffer
9f99e8231c
test_retrieve_container_basic
2026-01-24 14:31:54 -08:00
Ishaan Jaffer
f2fd54ffcf
test fixes
2026-01-24 14:27:56 -08:00
Ishaan Jaffer
d8e0c43a21
test fixes
2026-01-24 14:08:48 -08:00
Ishaan Jaffer
df3c54ec6a
BUMP extras
2026-01-24 14:04:30 -08:00
Ishaan Jaffer
e4e76a4963
test_team_update_sc_2
2026-01-24 13:17:32 -08:00
Ishaan Jaffer
489c986cac
test_hanging_request_azure
2026-01-24 13:14:48 -08:00
Ishaan Jaffer
a62ccd582d
fix flaky tests
2026-01-24 13:04:20 -08:00
Ishaan Jaffer
31a4cb65bf
test_get_default_unvicorn_init_args
2026-01-24 12:59:51 -08:00
Ishaan Jaffer
241c0c6d2a
docs fix
2026-01-24 12:32:18 -08:00
Ishaan Jaffer
6c6ed0dad2
docs fix
2026-01-24 12:11:39 -08:00
Ishaan Jaffer
28a9003103
docs fix
2026-01-24 12:10:42 -08:00
Ishaan Jaffer
bbeb007f4e
docs fix
2026-01-24 12:09:16 -08:00
Ishaan Jaffer
a081dc2ee2
docs fix
2026-01-24 11:41:16 -08:00
Ishaan Jaffer
a7e26460d0
fix unstable tests
2026-01-24 11:15:16 -08:00
Ishaan Jaffer
bd38374a45
fix: FLAKY tests
2026-01-24 11:13:44 -08:00
Alexsander Hamir
9cdd7a8fd2
Fix: log duplication when json_logs is enabled ( #19705 )
2026-01-24 11:09:04 -08:00
Ishaan Jaffer
6710abd1fa
test_web_search
2026-01-24 11:06:23 -08:00
Ishaan Jaffer
6587cd228b
test_partner_models_httpx_streaming
2026-01-24 10:58:35 -08:00
Ishaan Jaffer
1a7274aa4e
fix: _apply_search_filter_to_models mypy linting
2026-01-24 09:24:50 -08:00
Ishaan Jaffer
489d587332
CI/CD fixes - split local testing
2026-01-24 09:23:03 -08:00
yuneng-jiang
387cb8fde8
Merge pull request #19703 from BerriAI/yj_ui_build_jan24
...
[Infra] Build UI for Release
2026-01-24 09:20:26 -08:00
yuneng-jiang
17aec96186
chore: update Next.js build artifacts (2026-01-24 17:18 UTC, node v22.16.0)
2026-01-24 09:18:58 -08:00
Ishaan Jaffer
006b810370
bump: version 1.81.2 → 1.81.3
2026-01-24 09:15:06 -08:00
yuneng-jiang
ed1b9529f7
Merge pull request #19601 from BerriAI/litellm_ui_update_org_model
...
[Feature] UI - Organization Edit Page: Reusable Model Select
2026-01-24 09:10:15 -08:00
yuneng-jiang
5e395db1dc
Merge pull request #19604 from BerriAI/litellm_team_update_org
...
[Fix] Team Update with Organization having All Proxy Models
2026-01-24 09:09:55 -08:00
yuneng-jiang
f88a32de05
Merge pull request #19622 from BerriAI/litellm_ui_model_backend
...
[Feature] UI - Models Page: Model Search
2026-01-24 09:09:03 -08:00
yuneng-jiang
b44ac6c682
Fixing ruff check
2026-01-24 09:08:29 -08:00