Ishaan Jaffer
ce6102d54f
test_azure_responses_api_status_error
2025-10-11 10:41:15 -07:00
Ishaan Jaffer
86881a8fc1
test_azure_responses_api_status_error
2025-10-11 10:21:07 -07:00
Ishaan Jaffer
33a4676184
test fix
2025-10-11 10:05:22 -07:00
Ishaan Jaffer
732618f55f
test_together_ai_embedding
2025-10-11 09:33:19 -07:00
Ishaan Jaffer
c467986b8b
test_gemini_context_caching_with_ttl
2025-10-11 09:20:20 -07:00
Ishaan Jaffer
a163bf9f51
test fix: MicrosoftSSOHandler
2025-10-11 08:55:23 -07:00
Ishaan Jaffer
3aa0f6ed72
test_generate_key_with_object_permission
2025-10-11 08:54:15 -07:00
Ishaan Jaffer
4d79280175
Gemma test fixes
2025-10-11 08:51:08 -07:00
Ishaan Jaffer
87719640eb
test tag mgmt
2025-10-11 08:48:37 -07:00
Sameer Kankute
138bdbb6d8
fix mapped tests 1 ( #15445 )
...
* fix mapped tests
* fix mapped tests
2025-10-11 08:33:08 -07:00
Ishaan Jaffer
9bde1c1a4c
TestEnkryptAIGuardrailHooks
2025-10-10 19:59:41 -07:00
Ishaan Jaffer
8cb66168bc
test fix
2025-10-10 19:57:17 -07:00
Alexsander Hamir
5f5a7c917a
fix: handle closed aiohttp sessions with detection and retry ( #15442 )
...
Fixes RuntimeError "Session is closed" by:
- Checking session.closed before use and recreating if needed
- Catching RuntimeError during requests and retrying with new session
- Validating newly created sessions aren't already closed
Adds tests for both proactive detection and reactive retry scenarios.
2025-10-10 19:42:58 -07:00
Alexsander Hamir
2c9356c437
[Fix] - shared session parsing and usage issue ( #15440 )
...
* Fix: Add shared_session to all_litellm_params to prevent JSON serialization error
The shared_session parameter (aiohttp.ClientSession) was being passed through
to provider API calls, causing "Object of type ClientSession is not JSON
serializable" errors during embedding requests.
Added shared_session to the all_litellm_params list so it's properly filtered
out as a LiteLLM-internal parameter and not passed to the provider's API.
* Fix: Add shared_session support for embedding calls with connection pooling
The shared_session parameter was not being properly handled in embedding calls,
causing it to be passed through to provider API requests where it's not needed.
Changes:
- Added shared_session to all_litellm_params to filter it from provider API request body
- Extract shared_session in main embedding() function and pass it explicitly
- Updated OpenAI embedding handlers (embedding() and aembedding()) to accept shared_session
- Pass shared_session to _get_openai_client for HTTP client creation
This enables proper connection pooling for embedding requests when shared_session
is provided, improving performance for high-throughput scenarios.
* test: add regression test for shared_session in embedding calls
Add comprehensive test to prevent JSON serialization errors when using
shared_session.
The test verifies two critical aspects:
1. shared_session is in all_litellm_params to prevent "Object of type
ClientSession is not JSON serializable" errors
2. shared_session flows through the complete call chain across 6 layers:
- litellm.embedding()
- OpenAI.embedding/aembedding()
- _get_openai_client()
- AsyncHTTPHandler.create_client()
- _create_async_transport()
- _create_aiohttp_transport()
Similar to test_acompletion_session_reuse_e2e.py but focused on
embedding endpoints. Uses inspect.getsource() to verify the parameter
is not only accepted but actually passed through each layer.
2025-10-10 19:26:53 -07:00
Ishaan Jaff
527c8f59fa
[Feat] Tag Management - Add support for setting tag based budgets ( #15433 )
...
* feat: add LiteLLM_TagTable
* fix: use new table for tag management
* fix - allow setting budgets for tags
* working tag creation
* fix schema.prisma
* add tag info
* ui fixes
* ui fix tag info
* TAG_CACHE_IN_MEMORY_TTL_SECONDS
* add Litellm_EntityType
* fix get_aggregated_db_spend_update_transactions
* fix: _update_entity_spend_in_db
* fix _tag_max_budget_check
* add tag budget check
* add tag_list_transactions
* test_get_tag_objects_batch
* test_update_tag_db_without_prisma_client
* fix get_tags_from_request_body
* get_tags_from_request_body
* fix get_tags_from_request_body
* fix spend tracking utils
* get_tags_from_request_body
* test_get_tags_from_request_body_with_metadata_tags
* feat: add _update_tag_cache spend tracking
* fix _PROXY_track_cost_callback
* test_tag_cache_update_multiple_tags
* fix tag info
* docs fix
* docs tag budgets
* doc fix
* docs fix
* fix tag budget
* docs tag budgets
* docs fix
* ruff fix
2025-10-10 19:24:50 -07:00
Alexsander Hamir
9d7dea42d0
[Fix] - SensitiveDataMasker converts lists to string ( #15420 )
...
* fix: preserve lists in SensitiveDataMasker to prevent string conversion
Added 'list' to allowed primitive types in mask_dict() to prevent lists like
tags from being converted to string representations in API responses.
Before: {"tags": "['East US 2', 'production', 'test']"}
After: {"tags": ["East US 2", "production", "test"]}
* add: unit test
2025-10-10 17:50:51 -07:00
Copilot
b9eb05ea63
[Feature]: Include server_name in /v1/mcp/server/health endpoint response ( #15431 )
...
* Initial plan
* Add server_name to MCP health check response
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-10-10 17:37:53 -07:00
Ishaan Jaff
bf209415da
[Feat] VertexAI Gemma model family streaming support + Added MedGemma ( #15427 )
...
* test_acompletion_filters_stream_and_stream_options
* fix: stream_options
* docs medgemma
* lint fix
* docs
2025-10-10 14:22:27 -07:00
Ishaan Jaff
ed62d6c943
[Fix] VertexAI - gemma model family support (custom endpoints) ( #15419 )
...
* TestVertexGemmaiCompletion
* test vertex Gemma
* fix file name
* fix file naming
* add VertexAIGemmaModels
* add cost_router for vertexai
* fix main.py
* fix VertexGemmaConfig
* fix Vertex AI Gemma-AI Models Handler
* docs gemma
* fix ids
* test fix
* ruff check fixes
* docs fix
* docs fix
* test_acompletion_basic_request
* Revert "test_acompletion_basic_request"
This reverts commit fdaa5bc49e
2025-10-10 13:30:43 -07:00
Sameer Kankute
513925fd12
Add OCI Cohere support with tool calling and streaming capabilities ( #15365 )
...
* Add cohere models for OCI integration
* fix mypy error
2025-10-10 11:20:18 -07:00
Krish Dholakia
9c3e29b9f0
Merge pull request #15330 from jlan-nl/litellm-fix-erroneous-gpt5-cooldown-trigger
...
Minimal fix: gpt5 models should not go on cooldown when called with temperature!=1
2025-10-09 22:34:30 -07:00
Krish Dholakia
611a876889
Merge pull request #15380 from BerriAI/litellm_shared_heatlh_status
...
Implement Shared Health Check State Across Pods
2025-10-09 22:25:45 -07:00
Krish Dholakia
e1e1ea31dc
Merge pull request #15379 from PostHog/feat/posthog-per-request-api-key
...
feat: posthog per request api key
2025-10-09 22:24:51 -07:00
Ishaan Jaff
52bbabd788
[Feat] Support for Vertex AI Gemma Models on Custom Endpoints ( #15397 )
...
* TestVertexGemmaiCompletion
* test vertex Gemma
* fix file name
* fix file naming
* add VertexAIGemmaModels
* add cost_router for vertexai
* fix main.py
* fix VertexGemmaConfig
* fix Vertex AI Gemma-AI Models Handler
* docs gemma
* fix ids
* test fix
* ruff check fixes
* docs fix
* docs fix
2025-10-09 19:20:02 -07:00
Ishaan Jaff
4827e62a21
Fix - OpenRouter cache_control to only apply to last content block ( #15395 )
...
* fix: _move_cache_control_to_content
* test_openrouter_transform_request_with_cache_control_list_content
* fix code QA check
* fix: mypy lint
* fix handlers
* fix mypy
* fix - refactor code, fixes for QA checks
2025-10-09 18:01:33 -07:00
Krish Dholakia
eb0b263532
Merge pull request #15340 from BerriAI/litellm_db_config_accidental_override_fix
...
fix: Prevents DB from accidentally overriding config file values if they are empty in DB
2025-10-09 17:31:59 -07:00
Alexsander Hamir
c7234ba053
[Fix] - Sessions not being shared ( #15388 )
...
* fix: share sessions
* fix: remove limit
* clean up
* fix: add missing consts
* add: E2E test
* fix: remove redefinition of unused verbose_logger
* fix: missing const import
2025-10-09 16:57:40 -07:00
Ishaan Jaff
6cf57d85c3
[Feat] Add EnkryptAI Guardrails on LiteLLM ( #15390 )
...
* feat: add EnkryptAIGuardrail
* fix types
* fix EnkryptAIGuardrails
* __all__ = ["EnkryptAIGuardrail"]
fix
* fix EnkryptAIGuardrail
* TestEnkryptAIExtraction
* fix mypy linting
* docs enkrypt ai
* add EnkryptAIGuardrailConfigModel
* fix EnkryptAIGuardrailConfigModel
* fix import struct
* fix EnkryptAIGuardrails
2025-10-09 16:27:04 -07:00
Sameer Kankute
dce6cd1051
Add shared healthcheck
2025-10-09 22:18:05 +05:30
Carlos Marchal
dd560f792e
feat: posthog per request api key
2025-10-09 18:32:11 +02:00
Tim Elfrink
02f0b1e83a
Merge latest changes from origin/main into fix/redact-aws-credentials
...
Resolved import conflict for CustomPricingLiteLLMParams which was moved
from litellm.types.router to litellm.types.utils in main branch.
2025-10-09 08:12:22 +02:00
Krish Dholakia
e2e0cdde31
Merge pull request #15315 from lcfyi/lcfyi/add-support-for-parallel-tool-calls
...
Fix parallel tool calls in the Anthropic passthrough adapter
2025-10-08 23:01:55 -07:00
Krish Dholakia
4615298ba1
Merge pull request #15336 from BerriAI/litellm_fix_litellm_Param_costing
...
Fix litellm_param based costing
2025-10-08 22:55:41 -07:00
Achintya Rajan
95e71b31a8
Update test_proxy_utils.py
2025-10-08 19:25:54 -07:00
Achintya Rajan
169c1f0f21
moved test to test_proxy_server
2025-10-08 19:24:16 -07:00
Krish Dholakia
d921df1baf
Merge pull request #15343 from BerriAI/litellm_dev_10_08_2025_p1
...
MCP - support converting OpenAPI specs to MCP servers
2025-10-08 19:10:04 -07:00
Krish Dholakia
12a1d081ee
Merge branch 'main' into litellm_dev_09_11_2025_p1
2025-10-08 19:02:58 -07:00
Ishaan Jaffer
c4022ade49
test mapped tests MCP
2025-10-08 18:34:30 -07:00
Copilot
4226314096
Add native Responses API support for litellm_proxy provider ( #15347 )
...
* Initial plan
* Add native Responses API support for litellm_proxy provider
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-10-08 18:31:26 -07:00
Achintya Rajan
4bebb57611
moved test to test_litellm
2025-10-08 18:28:10 -07:00
Ishaan Jaff
2f42c806cb
[Fix] x-litellm-cache-key header not being returned on cache hit ( #15348 )
...
* fix: x-cache-key
* test_cache_key_in_hidden_params_acompletion
* fix: remove_cache_control_flag_from_messages_and_tools
2025-10-08 18:10:43 -07:00
Ishaan Jaff
97031dc8ee
Fix - (openrouter): move cache_control to content blocks for claude/gemini ( #15345 )
...
* test_openrouter_transform_request_with_cache_control
* fix CacheControlSupportedModels
* test_openrouter_transform_request_with_cache_control_gemini
2025-10-08 17:41:04 -07:00
Pierre-Emmanuel MERCIER
861750790b
feat: add redis ssl and username support ( #11319 )
2025-10-08 16:48:07 -07:00
Krrish Dholakia
cd13e533a2
feat(mcp_server_manager.py): expand allowed/disallowed list
2025-10-08 16:06:17 -07:00
Krrish Dholakia
28698933fc
feat(mcp_server_manager.py): ensure list tools for openapi servers works as expected
2025-10-08 15:59:42 -07:00
Ishaan Jaff
1c56a0d856
[Fix] Watsonx - Apply correct prompt templates for openai/gpt-oss model family ( #15341 )
...
* fix: apply_prompt_template
* Revert "fix: apply_prompt_template"
This reverts commit 3e0e40b4973e80903796
2025-10-08 15:39:36 -07:00
Achintya Rajan
ce8a520a86
new deep merge behavior when processing config
2025-10-08 14:41:41 -07:00
Sameer Kankute
85d4142845
Fix litellm_param based costing
2025-10-08 21:14:23 +05:30
IQHL (Hans Jacob Landelius)
6633b33085
formatting
2025-10-08 14:15:15 +02:00
IQHL (Hans Jacob Landelius)
5b9d516e43
unit test
2025-10-08 13:58:25 +02:00
