Commit graph

30591 commits

Author SHA1 Message Date
Yuneng Jiang
54be1f5043
chore: fixes
Some checks failed
Unit Tests: Caching (Redis) / caching-redis (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (auth-checks, tests/proxy_unit_tests/test_auth_checks.py tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (key-generation, tests/proxy_unit_tests/test_key_generate_prisma.py, 30, 0) (push) Has been cancelled
Unit Tests: Proxy DB Operations / proxy-db (remaining, tests/proxy_unit_tests --ignore=tests/proxy_unit_tests/test_key_generate_prisma.py --ignore=tests/proxy_unit_tests/test_auth_checks.py --ignore=tests/proxy_unit_tests/test_user_api_key_auth.py, 20, 8) (push) Has been cancelled
Unit Tests: Security / security (push) Has been cancelled
2026-04-05 01:41:25 -07:00
Sameer Kankute
3f8e985b58 Fix: skip auth for custom api base in vertex ai 2026-01-20 12:36:25 +05:30
Ishaan Jaffer
ea2e360cb5 docs 2026-01-19 19:49:51 -08:00
Ishaan Jaffer
f865f92bec docs plugin marketplaces 2026-01-19 19:42:15 -08:00
Will Chen
2761077820
docs: fix vertex_region to vertex_location in Vertex AI pass-through docs (#19380)
The documentation incorrectly used `vertex_region` as the parameter name,
but the actual parameter expected by LiteLLM is `vertex_location` as defined
in VertexPassThroughCredentials and other type definitions.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-19 19:15:17 -08:00
Ishaan Jaff
8c72cacaa4
[Feat] UI - Allow Adding Claude Code Plugins (#19387)
* init schema

* init endpoints

* fix: claude_code_marketplace_router

* refactor

* fix: claude_code_marketplace_router

* claude_code_marketplace_router

* add netwroking methods

* add plugin lefnat

* add plugin form

* add plugin on marketplace / ai hub

* fix find mant bug

* ui fix
2026-01-19 19:08:59 -08:00
Connor Luebbehusen
d48df6c17d
fix: correct us.anthropic.claude-opus-4-5 In-region pricing (#19310) 2026-01-19 19:00:24 -08:00
Sameer Kankute
d319517963
Merge pull request #19369 from Lucky-Lodhi2004/fix-tool-call-ollama
Fix #19357 - [Bug]: Tool call fails when using Ollama backend
2026-01-20 08:01:34 +05:30
Ishaan Jaff
818913ee23
[Fix] Fix Pass through routes to work with server root path (#19383)
* test_build_full_path_with_root_default

* fix pt feat
2026-01-19 18:28:55 -08:00
Alexsander Hamir
270b41b0f4
Simplify file comments (#19382) 2026-01-19 17:01:38 -08:00
Krrish Dholakia
13bcecb13e docs: fix doc title 2026-01-19 14:18:59 -08:00
Ishaan Jaff
a82467d679
[Feat] - Add self hosted Claude Code Plugin Marketplace (#19378)
* init schema

* init endpoints

* fix: claude_code_marketplace_router

* refactor

* fix: claude_code_marketplace_router

* claude_code_marketplace_router
2026-01-19 14:05:47 -08:00
Alexsander Hamir
3cdeebb5b8
fix(gcs_bucket): prevent unbounded queue growth due to slow API calls (#19297) 2026-01-19 10:47:56 -08:00
Connor Luebbehusen
2ba7d2e821
fix: correct Groq gpt-oss pricing and add cache pricing (#19311) 2026-01-19 10:41:28 -08:00
R.Sicart
608979c7e9
feat: add support for keda in helm chart (#19337)
* feat: add support for keda in helm chart

Signed-off-by: R.Sicart <roger.sicart@gmail.com>

* chore: bump chart version

---------

Signed-off-by: R.Sicart <roger.sicart@gmail.com>
2026-01-19 10:38:41 -08:00
Harshit Jain
99c4ba7adf
docs: fix bad examples from sdk (#19322) 2026-01-19 10:27:25 -08:00
Ishaan Jaff
e817aa713e
[Fix] Claude Code x Bedrock Invoke fails with advanced-tool-use-2025-11-20 (#19373)
* _filter_unsupported_beta_headers_for_bedrock

* test_bedrock_sonnet_4_5_with_advanced_tool_use_beta_header
2026-01-19 10:16:18 -08:00
Lucky Lodhi
74d3b11290 undid changes 2026-01-19 17:38:29 +00:00
Lucky Lodhi
c4013a34b8 fix tool call for ollama - #19357 2026-01-19 17:20:18 +00:00
Alexsander Hamir
0cd7763d5f
Add health check scripts and parallel execution support (#19295)
- Add health_check_client.py for monitoring model availability
- Add health_check_client_README.md with usage documentation
- Add health_check_requirements.txt for dependencies
- Add run_parallel_health_checks.ps1 (PowerShell version)
- Add run_parallel_health_checks.sh (Bash version)
- Organize all scripts under scripts/health_check/ directory
2026-01-19 08:38:38 -08:00
Krish Dholakia
0862373b38
docs: add note about no limits on users/keys/teams in LiteLLM OSS (#19367)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-01-19 08:22:18 -08:00
Sameer Kankute
bb67f9267a
Merge pull request #19354 from BerriAI/litellm_fix_streaming_test
Fix : test_responses_streaming_failure_triggers_failure_handlers
2026-01-19 21:22:53 +05:30
Lucky Lodhi
15e8eea0b5 Merge remote-tracking branch 'upstream/main' into fix-litellm-params 2026-01-19 14:21:44 +00:00
superpoussin22
1be7e87783
Fix HTML entity in survey description text (#19307) 2026-01-19 06:20:08 -08:00
Cesar Garcia
4d6a430adc
docs: update UI contributing guide (#19353)
* docs: update UI contributing guide with correct commands

- Replace outdated proxy_cli.py command with poetry run litellm
- Add config.yaml example with required settings
- Clarify that UI comes pre-built in the repo
- Add two development options: Build Mode and Dev Mode (hot reload)
- Note about redirect issues in Dev Mode

* docs: add hot reload login flow and PR submission section

- Document the 3000 -> 4000 -> 3000 login flow for hot reload
- Reorder: Hot Reload as Option A, Build Mode as Option B
- Add section 4 on submitting PRs
- Add note that UI changes don't require tests

* Update login flow navigation URL in contributing.md
2026-01-19 06:18:45 -08:00
Sameer Kankute
9e405ce6cc
Merge pull request #19323 from BerriAI/litellm_fix_stability_issues12
[Fix] Bedrock stability model usage issues
2026-01-19 19:43:32 +05:30
Sameer Kankute
ff7bb59824
Merge branch 'main' into litellm_fix_streaming_test 2026-01-19 19:43:16 +05:30
Sameer Kankute
c9de4776bc Fix test_process_chunk_exception_calls_handle_failure_once 2026-01-19 19:39:12 +05:30
Sameer Kankute
d6baa9a4ba
Merge pull request #19234 from BerriAI/litellm_staging_01_16_2026
Litellm staging 01 16 2026
2026-01-19 19:34:53 +05:30
Sameer Kankute
ac24696556 Remove runtime error 2026-01-19 19:19:16 +05:30
Cesar Garcia
b49f0a91e4
fix(responses): resolve deepcopy error with tool_choice ValidatorIterator (#17192) (#17205)
Replace copy.deepcopy with model_dump + model_validate in streaming
iterator logging to handle Pydantic ValidatorIterator objects that
cannot be pickled when tool_choice uses allowed_tools mode.

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2026-01-19 05:44:20 -08:00
Sameer Kankute
daf70f7221
Merge pull request #19329 from BerriAI/litellm_vector_store_sync
Fix: vector store sync issues
2026-01-19 19:11:48 +05:30
Sameer Kankute
e126e98a7f Fix azure image mypy issues 2026-01-19 19:10:43 +05:30
Sameer Kankute
42175a411d Fix streaming tests 2026-01-19 19:04:52 +05:30
Sameer Kankute
443b888d84
Merge pull request #19352 from BerriAI/revert-19158-main
Revert "Fix audio cost per second override"
2026-01-19 18:52:08 +05:30
Sameer Kankute
574391c118
Revert "Fix audio cost per second override (#19158)"
This reverts commit 2a0f87bde0.
2026-01-19 18:51:08 +05:30
Sameer Kankute
6eb3f579d7 Fix module import for opentelemetry 2026-01-19 18:50:18 +05:30
Sameer Kankute
2e6ce1469e Fix module import for opentelemetry 2026-01-19 18:47:28 +05:30
Sameer Kankute
75932e08da
Merge pull request #19349 from BerriAI/litellm_doc_update_05
Fix: update the doc
2026-01-19 18:25:43 +05:30
Sameer Kankute
351f921561
Merge pull request #19347 from BerriAI/litellm_fix_replicate_output
Fix Output None for replicate handler
2026-01-19 18:25:25 +05:30
Sameer Kankute
480fa13b1d
Merge pull request #19343 from BerriAI/litellm_anthropic_header_fix_19_jan
Fix: anthropic-beta is getting overriden and set to anthropic-beta
2026-01-19 18:24:46 +05:30
Sameer Kankute
a9475be06d
Merge pull request #19338 from BerriAI/litellm_fix_managed_load_balancing_batches
Add managed files support when load_balancing is True
2026-01-19 18:24:21 +05:30
Sameer Kankute
a8883a45bf
Merge pull request #19327 from BerriAI/litellm_vertex_ai_file_upload
Fix: upload pdfs for file endpoint
2026-01-19 18:23:41 +05:30
Sameer Kankute
68294228c2
Merge pull request #19326 from BerriAI/litellm_handle_failer_2_times
Fix: _handle_failure method getting called 2 times
2026-01-19 18:22:44 +05:30
Sameer Kankute
896d1a7dad Fix Error: Found packages that need verification: 2026-01-19 18:18:24 +05:30
Sameer Kankute
c5a8d4e34e
Merge branch 'main' into litellm_staging_01_16_2026 2026-01-19 18:11:21 +05:30
Sameer Kankute
d5293af053 Fix: update the doc 2026-01-19 17:57:00 +05:30
Sameer Kankute
58daf3eabf Fix Output None for replicate handler 2026-01-19 17:22:06 +05:30
Sameer Kankute
d7b103158a Fix: anthropic-beta is getting overriden and set to anthropic-beta': 'structured-outputs-2025-11-13', 2026-01-19 16:43:27 +05:30
Sameer Kankute
eea24978b9 Add managed files support when load_balancing is True 2026-01-19 15:54:04 +05:30