Boopesh Shanmugam
8b338a4d8c
User Headers X LiteLLM Users Mapping feature ( #14485 )
...
* Draft commit.
* user header mapping feature with backward compatibility with user_header_name field.
* user header mapping feature with backward compatibility with user_header_name field optimizations.
* Added unit tests.
2025-09-12 11:49:37 -07:00
Fabrício Ceschin
dae5b0f0f3
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-12 09:49:10 -04:00
Elias TOURNEUX
ef9d1ddc40
feat: Add OVHCloud AI Endpoints as a provider
2025-09-12 13:37:03 +02:00
rasmus.arpe@gmail.com
b8c362e443
add tests for the fix
2025-09-12 12:07:08 +02:00
Krish Dholakia
f8036a25a2
Merge pull request #14455 from lmnr-ai/fix/async-logging-tasks-context
...
propagate execution context into logging tasks
2025-09-12 00:36:08 -07:00
Krish Dholakia
113d2a8c5a
Merge pull request #14459 from holzman/fix-provider-budget
...
Fix provider budgets
2025-09-12 00:34:52 -07:00
Krish Dholakia
0413a701a2
Merge pull request #14460 from Sameerlite/litellm_vertex_gcs_bucket_issue
...
fix vertex ai file upload
2025-09-12 00:04:21 -07:00
Ishaan Jaff
32d87c242b
[Fixes] Using Qwen API Tiered Pricing ( #14479 )
...
* fix: use dashscope cost calc
* add qwen logo
2025-09-11 20:07:41 -07:00
Ishaan Jaff
69ef062f55
fix tiered_pricing test
2025-09-11 19:56:44 -07:00
Ishaan Jaff
51d5255452
[Bug]: Azure OpenAI & AI Foundry Reject Image Generation Payload Due to extra_body Injection in LiteLLM v1.76.3 ( #14475 )
...
* add request body azure img gen
* fix test_get_optional_params_image_gen_filters_empty_values
* test_azure_image_generation_request_body
* test_azure_image_generation_request_body
2025-09-11 19:39:06 -07:00
Krrish Dholakia
0c8b311155
test: add unit testing for both flows on key unblock
2025-09-11 19:15:15 -07:00
Krrish Dholakia
805069c287
fix(adapters/streaming_iterator.py): Don't send content block after message delta block is sent
...
Fixes https://github.com/BerriAI/litellm/issues/14315
2025-09-11 18:52:02 -07:00
Ishaan Jaff
dda115cc6d
[Feat] Cost Tracking - Add support for Tiered Cost Tracking for Qwen API (Dashscope) ( #14471 )
...
* add dashscope logo
* docs fix
* docs fix
* fix supports_batch_calling
* fix naming
* fix input_cost_per_audio_token
* use output_cost_per_reasoning_token
* add tiered_pricing in get_model_info
* test fixes
* fix cost calc
* ruff fix
2025-09-11 18:14:39 -07:00
Krrish Dholakia
d0732f55b3
test(test_get_azure_ad_token_provider.py): add unit test to ensure default azure credentials used in the right context
2025-09-11 16:07:32 -07:00
Burt Holzman
e9e548d797
Fix provider budgets
2025-09-11 12:08:43 -05:00
Sameer Kankute
090e0fddf4
fix vertex ai file upload
2025-09-11 22:20:54 +05:30
Din
ee5a9d0aa0
propagate execution context into logging tasks
2025-09-11 15:54:40 +01:00
Fabrício Ceschin
5cb5268e43
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-11 10:15:22 -04:00
Tom Alon
b83b497d38
PR fixes
2025-09-11 13:38:06 +03:00
Tom Alon
b473344f70
Implement anonymization logic
2025-09-11 11:47:19 +03:00
Ishaan Jaff
258b674dbb
fix deepinfra test
2025-09-10 19:39:23 -07:00
Ishaan Jaff
a13aa4740a
[Fixes] Bug fixes to using LiteLLM MCP Gateway ( #14392 )
...
* fix: use _get_mcp_servers_in_path
* fix checks for using litellm_proxy as MCP tool provider
* fix: fix mcp_tools_with_litellm_proxy
* fix: fix aresponses_api_with_mcp
* aresponses_api_with_mcp
* test_mcp_allowed_tools_filtering
* fix: _filter_mcp_tools_by_allowed_tools
* fix: _filter_mcp_tools_by_allowed_tools
* test_streaming_responses_api_with_mcp_tools
* fixes: test tools transfrom MCP->OpenaI spec
* test_streaming_responses_api_with_mcp_tools
* fix: chat ui allow multi select with allowed tools
* fix: use correct MCP events with litellm proxy response API
* fix get_event_model_class
* fix litellm proxy MCP handler
* fix MCPEnhancedStreamingIterator
* chat ui show list tools result
* UI: show MCP events
* fix stream iterator
* fixes: litellm proxy mcp handler
* test responses + mcp
* fix: update responses api with mcp handling
* ruff check fix
* central: _process_mcp_tools_to_openai_format
* fix: refactor code
* test_mcp_allowed_tools_filtering
* test mcp with litellm proxy
* fix mcp call
* demo: video using MCP ui
* fixes for using stream iterator
* test_no_duplicate_mcp_tools_in_streaming_e2e
* docs fix
* fix code snippet
2025-09-10 19:12:11 -07:00
Ishaan Jaff
dc5650eeda
Revert "fix: remove anthropic-beta header for Vertex AI requests with prompt caching" ( #14421 )
2025-09-10 15:47:18 -07:00
iabhi4
384ad7e99c
fix: avoid deepcopy crash with non-pickleables in Gemini/Vertex
2025-09-10 12:59:03 -07:00
xprilion
667481e75b
(feat): Add W&B Inference to LiteLLM
2025-09-11 00:07:30 +05:30
Tom Alon
f6bc4d0bf9
Noma non blocking on monitor mode
2025-09-10 13:35:17 +03:00
Krish Dholakia
a80cfe5fb5
Merge branch 'main' into feature/databricks-function-call-missing-pass-description
2025-09-09 22:42:32 -07:00
Krish Dholakia
53bf023876
Merge pull request #14092 from gotsysdba/main
...
OCI Provder: Update OCIPromptTokensDetails
2025-09-09 22:39:16 -07:00
Krish Dholakia
d72081113e
Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection
...
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
2025-09-09 22:35:30 -07:00
Krish Dholakia
03a457842d
Merge pull request #14310 from swarna1101/fix-anthropic-prompt-caching-vertex-ai
...
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
2025-09-09 22:32:40 -07:00
Krrish Dholakia
bdd7255bab
test: remove redundant tests - moved to parallel_request_limiter_v3.py
2025-09-09 21:35:50 -07:00
pinkgu
285b14bd69
Fix/gcp model armor ( #14381 )
...
* chore: fix model armor always success
Signed-off-by: bjorn <bjornjee95@gmail.com>
* chore: fix sanitisation field extraction
Signed-off-by: bjorn <bjornjee95@gmail.com>
---------
Signed-off-by: bjorn <bjornjee95@gmail.com>
2025-09-09 09:18:37 -07:00
swarnabhasinha
f8ddd123d1
fix: add missing patch import in vertex_ai test
2025-09-09 16:16:59 +05:30
Krish Dholakia
54c3ae15c8
Merge pull request #14312 from mubashir1osmani/main
...
fix: spend tags endpoint returns 500
2025-09-08 19:05:13 -07:00
Fabricio Ceschin
faaae888f1
Merge conflicts
2025-09-08 11:34:45 -04:00
Dharamendra Kumar
5b26e78ad6
Fix linting
2025-09-07 18:04:00 -07:00
Dharamendra Kumar
92596e48fe
Merge branch 'main' into feature/aiohttp-dependency-injection
2025-09-07 17:54:55 -07:00
mubashir1osmani
d9bbbc10a6
added tests
2025-09-07 10:17:28 -04:00
Krish Dholakia
fbc0ec98b6
Merge pull request #12438 from jasonpnnl/fix-customer-update
...
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
2025-09-06 22:12:30 -07:00
Krish Dholakia
ba10173ec7
Merge branch 'main' into heroku-llms
2025-09-06 22:10:20 -07:00
Krish Dholakia
884cca7da9
Merge pull request #12984 from darashenka/main
...
honor OLLAMA_API_KEY for ollama_chat
2025-09-06 22:07:28 -07:00
Krish Dholakia
db6fd68540
Merge pull request #14160 from BerriAI/litellm_dev_09_01_2025_p1
...
MINOR update: Add openrouter image generation support + refactor Gemini `image` output param to be `images` (openrouter compatible)
2025-09-06 19:26:00 -07:00
Ishaan Jaff
c9ab104445
[Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes ( #14305 )
...
* Implement pass-through route registration and removal to prevent duplicates and memory leaks
* fix MYPY linting
* fix InitPassThroughEndpointHelpers
* fix test_aaparallel_function_call
---------
Co-authored-by: Jugal Bhatt <jugalbhatt3@gmail.com>
2025-09-06 19:22:25 -07:00
Krrish Dholakia
5a0328b1a9
test: update tests
2025-09-06 19:02:03 -07:00
Ishaan Jaff
d89a2a0797
test
2025-09-06 16:38:43 -07:00
Ishaan Jaff
c168fff38a
test_cooldown_badrequest_error
2025-09-06 16:28:00 -07:00
Ishaan Jaff
7054067238
test_cooldown_handlers.py
2025-09-06 16:13:30 -07:00
Ishaan Jaff
7f5460465c
unit test oai pass through
2025-09-06 14:54:34 -07:00
Ishaan Jaff
b1552cae46
fix mocked CZ tests
2025-09-06 14:33:02 -07:00
Ishaan Jaff
8920a645e9
Revert "feat: add redis ssl and username support ( #11319 )" ( #14303 )
...
This reverts commit 31f806f7d0
2025-09-06 14:01:00 -07:00
