Sameer Kankute
110ce543c2
[Feat]Add cancel endpoint support for openai and azure ( #14561 )
...
* Add cancel endpoint support for openai
and azure
* fix lint error
* fix cancel url contruction azure
* readd changes
2025-09-15 07:08:56 -07:00
Fabrício Ceschin
1a715b2eb3
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-15 09:20:27 -04:00
Anubhav Singh
67276a8151
Merge branch 'main' into wandb-inference
2025-09-15 18:34:16 +05:30
LingXuanYin
c9e1088fda
update docs
2025-09-15 16:17:09 +08:00
LingXuanYin
3bbe09ceb9
update test volcengine
2025-09-15 14:03:15 +08:00
LingXuanYin
bf7868bb0e
fix volcengine thinking parameters missing if set disable
...
update test volcengine
2025-09-15 13:15:05 +08:00
iabhi4
4ba3a21042
fix(proxy): Correctly parse multi-part MCP server aliases from URL paths
2025-09-14 15:17:08 -07:00
Tim Elfrink
9521414efa
Resolve merge conflict by including both CompactifAI and OVHCloud providers
...
- Keep CompactifAI provider detection logic
- Include new OVHCloud provider from main branch
- Both providers now work correctly with model prefix detection
2025-09-14 23:03:18 +02:00
Tim Elfrink
6ac37093e5
Update CompactifAI model references and move tests to unit test directory
...
- Update all model references from llama-2-7b-compressed to cai-llama-3-1-8b-slim
- Move CompactifAI tests from tests/llm_translation to tests/test_litellm/llms/compactifai/
- Update documentation examples to use the new model name
- Remove integration test inheritance to make tests pure mock tests
This addresses review feedback to use mock tests and updated model naming.
2025-09-14 23:00:27 +02:00
iabhi4
dc27bccb45
feat(proxy): Assign default budget to auto-generated JWT teams
2025-09-14 12:04:43 -07:00
mubashir1osmani
e694cc102a
feat: Add Spend metrics in datadog
2025-09-14 14:42:26 -04:00
Krrish Dholakia
03f2be1e20
fix: fix race conditions
2025-09-14 09:41:04 -07:00
Krrish Dholakia
2c6481fa33
fix: remove incorrect test
2025-09-14 09:34:31 -07:00
Krish Dholakia
510332b886
Merge pull request #14491 from Rasmusafj/main
...
Resolve cache key collision issue where all soft budget alerts use identical cache keys
2025-09-14 00:51:27 -07:00
Krish Dholakia
56fd60b140
Merge pull request #14494 from eliasto/feat/ovhcloud-ai-edpoints-provider
...
feat: Add OVHCloud AI Endpoints as a provider
2025-09-14 00:45:08 -07:00
Krish Dholakia
11822e63f1
Merge pull request #14519 from uc4w6c/feat/add_tools_permission_guardrail
...
feat: add tool-permission guardrail
2025-09-13 23:22:31 -07:00
Krish Dholakia
dc4bbba0a5
Merge pull request #14520 from boopesh07/email_prometheus
...
Added user_email labels to the prometheus monitoring.
2025-09-13 23:19:46 -07:00
Krish Dholakia
2ec4b2953c
Merge pull request #14531 from mubashir1osmani/main
...
fix: DD tool calls passed in metadata
2025-09-13 23:16:15 -07:00
Ishaan Jaff
6172145014
fix: org budget update fix ( #14541 )
2025-09-13 16:34:26 -07:00
Krish Dholakia
6efc898407
Merge pull request #14523 from BerriAI/litellm_dev_09_12_2025_p1
...
VLLM - transcription endpoint support + Ollama_chat/ - images, thinking, and content as list handling +
2025-09-13 13:39:28 -07:00
Ishaan Jaff
252ec8e1ae
test_normal_router_call_tpm_v3
2025-09-13 12:04:56 -07:00
Ishaan Jaff
26dafdc493
test fix: note this does not play nice with circleCI, it passes on local
2025-09-13 11:37:19 -07:00
Krish Dholakia
269515e525
Merge branch 'main' into litellm_dev_09_12_2025_p1
2025-09-13 10:10:30 -07:00
Ishaan Jaff
69e451458c
test_logging_opentelemetry_context_propagation
2025-09-13 09:44:36 -07:00
Krish Dholakia
38efd358eb
Merge pull request #14401 from Noma-Security/noma_non_blocking_monitor_mode
...
Noma non blocking monitor mode & anonymize input support
2025-09-13 09:41:41 -07:00
Krish Dholakia
550feffeb9
Merge pull request #14512 from timelfrink/fix/lm-studio-bearer-header-14502
...
fix(lm_studio): resolve illegal Bearer header value issue
2025-09-13 09:40:30 -07:00
soojin
488b373835
test: add unit tests for response api bug fixes
2025-09-13 23:10:15 +09:00
mubashir1osmani
6156590190
added spend metrics
2025-09-13 01:38:08 -04:00
mubashir1osmani
fd11159148
fix: DD tool calls passed in metadata
2025-09-13 00:11:18 -04:00
Krish Dholakia
a11f50d8ba
Merge branch 'main' into litellm_dev_09_11_2025_p1
2025-09-12 19:59:28 -07:00
Krish Dholakia
663dbc6080
Merge pull request #14477 from BerriAI/litellm_dev_09_11_2025_p2
...
`/v1/messages` - don't send content block after message w/ finish reason + usage block + `/key/unblock` - support hashed tokens
2025-09-12 19:51:44 -07:00
Ishaan Jaff
075a089d82
[Feat] Bedrock Batches - Ensure correct transformation applied to incoming requests ( #14522 )
...
* use is_batch_jsonl_file
* fix valid_content_type
* fix transform_create_file_request
* fix _transform_openai_jsonl_content_to_bedrock_jsonl_content
* test_transform_openai_jsonl_content_to_bedrock_jsonl_content
* fix mypy linting errors
* fix BEDROCK_BATCH_MODEL
* fix working sample
* fix comment
* fix model list
* fix: use with managed batches
* refactor
2025-09-12 18:32:57 -07:00
Krrish Dholakia
8ec02a5bdc
test: add unit tests for ollama chat request transformation
2025-09-12 17:59:59 -07:00
boopesh07
36299dbc73
Added user_email labels to the prometheus monitoring.
2025-09-12 15:38:23 -07:00
Yuta Saito
1de7f076ac
feat: add tool-permission guardrail
2025-09-13 07:34:29 +09:00
Tim Elfrink
b84785b5b7
fix(lm_studio): resolve illegal Bearer header value issue
...
- Change default API key from space ' ' to 'fake-api-key'
- Fixes httpcore.LocalProtocolError: Illegal header value b'Bearer '
- Maintains compatibility with explicit API keys and environment variables
- Add comprehensive tests for provider info retrieval
Fixes #14502
2025-09-12 22:41:30 +02:00
Ishaan Jaff
18372f9ebe
Revert "fix vertex ai file upload" ( #14501 )
2025-09-12 12:02:24 -07:00
Sameerlite
fa175e8d90
Fix gemini cli error ( #14417 )
...
* Fix gemini cli error
* Added better handling
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-09-12 11:56:51 -07:00
Sameer Kankute
1a123b2cd5
Litellm gemini cli bug fix ( #14451 )
...
* Fix gemini cli error
* Add reasoning request support
* Added better handling
* remove other PR code
* refactored code for better structure following
---------
Co-authored-by: sameer@berri.ai <sameer@berri.ai>
2025-09-12 11:55:26 -07:00
Boopesh Shanmugam
8b338a4d8c
User Headers X LiteLLM Users Mapping feature ( #14485 )
...
* Draft commit.
* user header mapping feature with backward compatibility with user_header_name field.
* user header mapping feature with backward compatibility with user_header_name field optimizations.
* Added unit tests.
2025-09-12 11:49:37 -07:00
Fabrício Ceschin
dae5b0f0f3
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-12 09:49:10 -04:00
Elias TOURNEUX
ef9d1ddc40
feat: Add OVHCloud AI Endpoints as a provider
2025-09-12 13:37:03 +02:00
rasmus.arpe@gmail.com
b8c362e443
add tests for the fix
2025-09-12 12:07:08 +02:00
Krish Dholakia
f8036a25a2
Merge pull request #14455 from lmnr-ai/fix/async-logging-tasks-context
...
propagate execution context into logging tasks
2025-09-12 00:36:08 -07:00
Krish Dholakia
113d2a8c5a
Merge pull request #14459 from holzman/fix-provider-budget
...
Fix provider budgets
2025-09-12 00:34:52 -07:00
Krish Dholakia
0413a701a2
Merge pull request #14460 from Sameerlite/litellm_vertex_gcs_bucket_issue
...
fix vertex ai file upload
2025-09-12 00:04:21 -07:00
Ishaan Jaff
32d87c242b
[Fixes] Using Qwen API Tiered Pricing ( #14479 )
...
* fix: use dashscope cost calc
* add qwen logo
2025-09-11 20:07:41 -07:00
Ishaan Jaff
69ef062f55
fix tiered_pricing test
2025-09-11 19:56:44 -07:00
Ishaan Jaff
51d5255452
[Bug]: Azure OpenAI & AI Foundry Reject Image Generation Payload Due to extra_body Injection in LiteLLM v1.76.3 ( #14475 )
...
* add request body azure img gen
* fix test_get_optional_params_image_gen_filters_empty_values
* test_azure_image_generation_request_body
* test_azure_image_generation_request_body
2025-09-11 19:39:06 -07:00
Krrish Dholakia
0c8b311155
test: add unit testing for both flows on key unblock
2025-09-11 19:15:15 -07:00
