Commit graph

31779 commits

Author SHA1 Message Date
Harshit Jain
32562708ee
fix(proxy): add /a2a/{agent_id}/.well-known/agent-card.json to agent_routes allowlist (#19277) 2026-01-19 05:36:54 -08:00
Sameer Kankute
42175a411d Fix streaming tests 2026-01-19 19:04:52 +05:30
Sameer Kankute
443b888d84
Merge pull request #19352 from BerriAI/revert-19158-main
Revert "Fix audio cost per second override"
2026-01-19 18:52:08 +05:30
Sameer Kankute
574391c118
Revert "Fix audio cost per second override (#19158)"
This reverts commit 2a0f87bde0.
2026-01-19 18:51:08 +05:30
Jón Levy
5db0e3289a
fix(agentcore): simplify agentcore streaming (#17141)
* fix(agentcore): simplify agentcore streaming

* fix(agentcore): move CustomStreamWrapper import to module level

The deferred imports inside streaming methods caused initialization delays
during health check requests, leading to timeouts in ECS deployments.

- Move CustomStreamWrapper import to module-level (line 19)
- Remove deferred imports from get_sync_custom_stream_wrapper (line 588)
- Remove deferred import from get_async_custom_stream_wrapper (line 747)
- Remove from TYPE_CHECKING block to use actual import

This ensures the import happens at module load time rather than during
first request processing, preventing health check endpoint blocking.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

* test(agentcore): ensure sync response

* chore: upgrade boto3 to 1.40.76 in pyproject.toml

* chore: added taplo.toml

* fix(types): correct annotation type hint for MyPy compatibility

Update _convert_annotations_to_chat_format return type from
Dict[str, Any] to ChatCompletionAnnotation TypedDict to match
the Message class's expected type signature.

Co-Authored-By: Claude <noreply@anthropic.com>

---------

Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Benedikt Óskarsson <bensi94@hotmail.com>
2026-01-19 05:20:24 -08:00
Sameer Kankute
6eb3f579d7 Fix module import for opentelemetry 2026-01-19 18:50:18 +05:30
Harshit Jain
6cd4b3603f
fix(router): prevent retrying 4xx client errors (#19275) 2026-01-19 05:18:35 -08:00
Sameer Kankute
2e6ce1469e Fix module import for opentelemetry 2026-01-19 18:47:28 +05:30
Benedikt Óskarsson
f09cae2107
Merge branch 'main' into fix/bedrock-thinking-tool-call-2 2026-01-19 13:08:17 +00:00
Sameer Kankute
75932e08da
Merge pull request #19349 from BerriAI/litellm_doc_update_05
Fix: update the doc
2026-01-19 18:25:43 +05:30
Sameer Kankute
351f921561
Merge pull request #19347 from BerriAI/litellm_fix_replicate_output
Fix Output None for replicate handler
2026-01-19 18:25:25 +05:30
Sameer Kankute
480fa13b1d
Merge pull request #19343 from BerriAI/litellm_anthropic_header_fix_19_jan
Fix: anthropic-beta is getting overriden and set to anthropic-beta
2026-01-19 18:24:46 +05:30
Sameer Kankute
a9475be06d
Merge pull request #19338 from BerriAI/litellm_fix_managed_load_balancing_batches
Add managed files support when load_balancing is True
2026-01-19 18:24:21 +05:30
Sameer Kankute
a8883a45bf
Merge pull request #19327 from BerriAI/litellm_vertex_ai_file_upload
Fix: upload pdfs for file endpoint
2026-01-19 18:23:41 +05:30
Sameer Kankute
68294228c2
Merge pull request #19326 from BerriAI/litellm_handle_failer_2_times
Fix: _handle_failure method getting called 2 times
2026-01-19 18:22:44 +05:30
Sameer Kankute
896d1a7dad Fix Error: Found packages that need verification: 2026-01-19 18:18:24 +05:30
Sameer Kankute
c5a8d4e34e
Merge branch 'main' into litellm_staging_01_16_2026 2026-01-19 18:11:21 +05:30
Sameer Kankute
d5293af053 Fix: update the doc 2026-01-19 17:57:00 +05:30
Sameer Kankute
58daf3eabf Fix Output None for replicate handler 2026-01-19 17:22:06 +05:30
Chesars
45eb35938b fix: drop_params not dropping prompt_cache_key for non-OpenAI providers
Fixes #19225

Add prompt_cache_key and other missing OpenAI Chat Completions params
to DEFAULT_CHAT_COMPLETION_PARAM_VALUES so drop_params: true works.

Also fix additional_drop_params to filter extra params for all providers,
not just OpenAI/Azure.
2026-01-19 08:49:03 -03:00
Sameer Kankute
d7b103158a Fix: anthropic-beta is getting overriden and set to anthropic-beta': 'structured-outputs-2025-11-13', 2026-01-19 16:43:27 +05:30
Sameer Kankute
eea24978b9 Add managed files support when load_balancing is True 2026-01-19 15:54:04 +05:30
Sameer Kankute
514ebb0d96 Fix: vector store sync issues 2026-01-19 13:17:08 +05:30
Sameer Kankute
480cb9c0d8 Fix: upload pdfs for file endpoint 2026-01-19 11:58:32 +05:30
Yuta Saito
30f2c09401 feat: mcp version up 1.21.2 -> 1.25.0 2026-01-19 15:25:08 +09:00
YutaSaito
bb7aad9de1
Merge pull request #19319 from BerriAI/litellm_test_mcp_integration
[test] mcp integration test
2026-01-19 14:38:02 +09:00
Yuta Saito
44a166a792 fix: ci mcp version up 2026-01-19 14:27:00 +09:00
Yuta Saito
a141aa6026 test: temporary skip 2026-01-19 13:57:40 +09:00
Sameer Kankute
fbf2d83375 Fix: _handle_failure method getting called 2 times 2026-01-19 10:19:31 +05:30
Sameer Kankute
e1b73310ca Fix: llms/bedrock/image_edit/stability_transformation.py:153:9: PLR0915 Too many statements (55 > 50) 2026-01-19 09:16:12 +05:30
Sameer Kankute
49b2886ef0 Add None as default image value 2026-01-19 09:08:38 +05:30
Sameer Kankute
0a15f1b66a Fix: stability image optional para 2026-01-19 09:05:52 +05:30
Yuta Saito
1fbbe0a983 test: restore global MCP server manager after access-group test 2026-01-19 12:29:37 +09:00
Yuta Saito
30c4a38179 test: const 2026-01-19 12:03:26 +09:00
YutaSaito
14679cff3f
Merge pull request #19317 from BerriAI/litellm_fix-responses-api-non-openai-models
[fix] responses api non OpenAI models
2026-01-19 11:21:39 +09:00
Krish Dholakia
e326b397c5
docs: Add Google Workload Identity Federation (WIF) documentation to Vertex AI (#19320)
- Added new section documenting WIF support for Vertex AI authentication
- Included SDK and Proxy configuration examples
- Added sample WIF credentials file format for AWS federation
- Mentioned LLM Credentials UI as an alternative for credential management
- Added link to Google Cloud WIF documentation

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-01-18 18:18:01 -08:00
Yuta Saito
20b6468222 test: refactor 2026-01-19 11:17:44 +09:00
Yuta Saito
c2b5e9c669 test: MCP E2E streamable_http 2026-01-19 11:12:36 +09:00
Yuta Saito
737fec600f test: add mcp e2e test 2026-01-19 10:49:39 +09:00
Yuta Saito
60f40856e1 chore: fix lint error 2026-01-19 07:10:32 +09:00
Yuta Saito
d31c609600 test: Let MCP tool-execution mock accept new kwargs for streaming tests 2026-01-19 07:00:14 +09:00
Yuta Saito
4ad78236ab test: Fail MCP streaming test when LiteLLM logs errors during follow-up calls 2026-01-19 06:46:39 +09:00
Yuta Saito
cd19039e39 test: Parametrize MCP streaming test to cover OpenAI and Anthropic models 2026-01-19 06:22:05 +09:00
Yuta Saito
38afdb71ff fix: Prevent MCP responses from reviving past tool calls via previous_response_id 2026-01-19 06:03:10 +09:00
Yuta Saito
bc4fbf282a fix: Avoid attaching tool calls when a call_id already exists 2026-01-19 06:01:40 +09:00
Lucky Lodhi
20c3a0ffe4 fixed litellm params 2026-01-18 18:27:27 +00:00
YutaSaito
4dc9726db4
Merge pull request #19292 from BerriAI/litellm_docs_cursor-mcp
[docs] add cursor with mcp
2026-01-18 14:59:08 +09:00
Krish Dholakia
4fa1470fef
Add in-product nudge for claude code feedback survey + new learning centre (#19303)
* fix(proxy_setting_endpoints.py): add new GET /in_product_nudges route

allows for context-based nudges

* feat: initial commit, adding in-product nudge for claude code usage

helps us talk to more litellm x claude code users

* fix: link out to google form for claude code in-product nudge

* feat(index.json): add new guide

* feat(index.json): add new claude code guides

* fix: link out

* fix: remove baselines
2026-01-17 20:05:20 -08:00
mubashir1osmani
7db4460195 filter span kinds 2026-01-17 22:27:30 -05:00
Ishaan Jaffer
2fda7a2534 docs fix 2026-01-17 18:33:19 -08:00