scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-14 23:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 102
44733 commits 2357 branches 1407 tags 2.7 GiB
Commit graph

13345 commits

Author SHA1 Message Date
LingXuanYin
bf7868bb0e fix volcengine thinking parameters missing if set disable 
update test volcengine
 2025-09-15 13:15:05 +08:00
iabhi4
4ba3a21042 fix(proxy): Correctly parse multi-part MCP server aliases from URL paths 2025-09-14 15:17:08 -07:00
Tim Elfrink
9521414efa Resolve merge conflict by including both CompactifAI and OVHCloud providers 
- Keep CompactifAI provider detection logic
- Include new OVHCloud provider from main branch
- Both providers now work correctly with model prefix detection
 2025-09-14 23:03:18 +02:00
Tim Elfrink
6ac37093e5 Update CompactifAI model references and move tests to unit test directory 
- Update all model references from llama-2-7b-compressed to cai-llama-3-1-8b-slim
- Move CompactifAI tests from tests/llm_translation to tests/test_litellm/llms/compactifai/
- Update documentation examples to use the new model name
- Remove integration test inheritance to make tests pure mock tests

This addresses review feedback to use mock tests and updated model naming.
 2025-09-14 23:00:27 +02:00
iabhi4
dc27bccb45 feat(proxy): Assign default budget to auto-generated JWT teams 2025-09-14 12:04:43 -07:00
mubashir1osmani
e694cc102a feat: Add Spend metrics in datadog 2025-09-14 14:42:26 -04:00
Krrish Dholakia
03f2be1e20 fix: fix race conditions 2025-09-14 09:41:04 -07:00
Krrish Dholakia
2c6481fa33 fix: remove incorrect test 2025-09-14 09:34:31 -07:00
Krish Dholakia
510332b886
Merge pull request #14491 from Rasmusafj/main 
Resolve cache key collision issue where all soft budget alerts use identical cache keys
 2025-09-14 00:51:27 -07:00
Krish Dholakia
56fd60b140
Merge pull request #14494 from eliasto/feat/ovhcloud-ai-edpoints-provider 
feat: Add OVHCloud AI Endpoints as a provider
 2025-09-14 00:45:08 -07:00
Krish Dholakia
11822e63f1
Merge pull request #14519 from uc4w6c/feat/add_tools_permission_guardrail 
feat: add tool-permission guardrail
 2025-09-13 23:22:31 -07:00
Krish Dholakia
dc4bbba0a5
Merge pull request #14520 from boopesh07/email_prometheus 
Added user_email labels to the prometheus monitoring.
 2025-09-13 23:19:46 -07:00
Krish Dholakia
2ec4b2953c
Merge pull request #14531 from mubashir1osmani/main 
fix: DD tool calls passed in metadata
 2025-09-13 23:16:15 -07:00
Ishaan Jaff
6172145014
fix: org budget update fix (#14541) 2025-09-13 16:34:26 -07:00
Krish Dholakia
6efc898407
Merge pull request #14523 from BerriAI/litellm_dev_09_12_2025_p1 
VLLM - transcription endpoint support + Ollama_chat/ - images, thinking, and content as list handling +
 2025-09-13 13:39:28 -07:00
Krrish Dholakia
459e66a9cd fix: fix test 2025-09-13 13:38:35 -07:00
Ishaan Jaff
252ec8e1ae test_normal_router_call_tpm_v3 2025-09-13 12:04:56 -07:00
Ishaan Jaff
26dafdc493 test fix: note this does not play nice with circleCI, it passes on local 2025-09-13 11:37:19 -07:00
Krish Dholakia
269515e525
Merge branch 'main' into litellm_dev_09_12_2025_p1 2025-09-13 10:10:30 -07:00
Ishaan Jaff
ec32a0a7d7 fix: get_base_completion_call_args 2025-09-13 09:59:08 -07:00
Ishaan Jaff
69e451458c test_logging_opentelemetry_context_propagation 2025-09-13 09:44:36 -07:00
Krish Dholakia
38efd358eb
Merge pull request #14401 from Noma-Security/noma_non_blocking_monitor_mode 
Noma non blocking monitor mode & anonymize input support
 2025-09-13 09:41:41 -07:00
Krish Dholakia
550feffeb9
Merge pull request #14512 from timelfrink/fix/lm-studio-bearer-header-14502 
fix(lm_studio): resolve illegal Bearer header value issue
 2025-09-13 09:40:30 -07:00
Krish Dholakia
ad9515a81e
Merge branch 'main' into litellm_contributor_prs_09_12_2025_p1 2025-09-13 09:38:43 -07:00
soojin
488b373835 test: add unit tests for response api bug fixes 2025-09-13 23:10:15 +09:00
Tim Elfrink
e1329b03c6 Add comprehensive tests for CompactifAI provider 
- Test basic and streaming completions with proper mocking
- Cover authentication, parameter handling, and error scenarios
- Test provider detection and async functionality
- Verify request headers and response transformation
- Follow LiteLLM testing patterns with respx/httpx mocking
- Ensure full compatibility with OpenAI-style responses
 2025-09-13 08:41:30 +02:00
mubashir1osmani
6156590190 added spend metrics 2025-09-13 01:38:08 -04:00
mubashir1osmani
fd11159148 fix: DD tool calls passed in metadata 2025-09-13 00:11:18 -04:00
Krish Dholakia
a11f50d8ba
Merge branch 'main' into litellm_dev_09_11_2025_p1 2025-09-12 19:59:28 -07:00
Krish Dholakia
663dbc6080
Merge pull request #14477 from BerriAI/litellm_dev_09_11_2025_p2 
`/v1/messages` - don't send content block after message w/ finish reason + usage block + `/key/unblock` - support hashed tokens
 2025-09-12 19:51:44 -07:00
Krish Dholakia
e254d9013b
Merge pull request #14469 from sashank5644/litellm_log_key_alias_filtering 
Fixed Log Tab Key Alias filtering inaccurately for failed logs
 2025-09-12 19:46:17 -07:00
Ishaan Jaff
93af8fd6ba
[QA] E2E - Testing for bedrock batches api (#14525) 
* add bedrock/batch-anthropic.claude-3-5-sonnet-20240620-v1:0

* test_bedrock_batches_api

* fix

* fix import

* test_bedrock_batches_api
 2025-09-12 19:31:19 -07:00
Ishaan Jaff
075a089d82
[Feat] Bedrock Batches - Ensure correct transformation applied to incoming requests (#14522) 
* use is_batch_jsonl_file

* fix valid_content_type

* fix transform_create_file_request

* fix _transform_openai_jsonl_content_to_bedrock_jsonl_content

* test_transform_openai_jsonl_content_to_bedrock_jsonl_content

* fix mypy linting errors

* fix BEDROCK_BATCH_MODEL

* fix working sample

* fix comment

* fix model list

* fix: use with managed batches

* refactor
 2025-09-12 18:32:57 -07:00
Krrish Dholakia
8ec02a5bdc test: add unit tests for ollama chat request transformation 2025-09-12 17:59:59 -07:00
Arseny Boykov
f4318bccd3
[Performance] Use _PROXY_MaxParallelRequestsHandler_v3 by default again (#14450) 
* Use _PROXY_MaxParallelRequestsHandler_v3 by default (#14352)

(cherry picked from commit f3fa45cf8fbd5f5cce2f45a7312776d5005fb08e)
(cherry picked from commit 5b680bb4a3)

* Use random api_key for parallel requests test

* Fix off-by-one error in parallel request rate limit

The rate limiter was incorrectly rejecting requests when the limit was met, but not exceeded. The check in `is_cache_list_over_limit` was `int(counter_value) + 1 > current_limit`, which caused the first request to be rejected if the limit was 1.

This commit removes the `+ 1`, changing the logic to `int(counter_value) > current_limit`. The check now correctly allows requests up to the specified parallel limit.

* Test actual parallel requests

* Ensure rate limiting works correctly for multiple users

* Add sequential rate-limit test

* Revert random key usage
 2025-09-12 17:33:55 -07:00
boopesh07
36299dbc73 Added user_email labels to the prometheus monitoring. 2025-09-12 15:38:23 -07:00
Ishaan Jaff
e87e50328e
[Feat] Bedrock Batches - Working e2e flow to upload file + create batch (#14518) 
* fix: bedrock batches transform

* fix: upload_url

* fixes for model name

* fix upload_url

* fix bedrock batch test

* test_mock_bedrock_file_url_mapping
 2025-09-12 15:37:09 -07:00
Yuta Saito
1de7f076ac feat: add tool-permission guardrail 2025-09-13 07:34:29 +09:00
Tim Elfrink
b84785b5b7 fix(lm_studio): resolve illegal Bearer header value issue 
- Change default API key from space ' ' to 'fake-api-key'
- Fixes httpcore.LocalProtocolError: Illegal header value b'Bearer  '
- Maintains compatibility with explicit API keys and environment variables
- Add comprehensive tests for provider info retrieval

Fixes #14502
 2025-09-12 22:41:30 +02:00
Ishaan Jaff
18372f9ebe
Revert "fix vertex ai file upload" (#14501) 2025-09-12 12:02:24 -07:00
Sameerlite
fa175e8d90
Fix gemini cli error (#14417) 
* Fix gemini cli error

* Added better handling

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
 2025-09-12 11:56:51 -07:00
Sameer Kankute
1a123b2cd5
Litellm gemini cli bug fix (#14451) 
* Fix gemini cli error

* Add reasoning request support

* Added better handling

* remove other PR code

* refactored code for better structure following

---------

Co-authored-by: sameer@berri.ai <sameer@berri.ai>
 2025-09-12 11:55:26 -07:00
Boopesh Shanmugam
8b338a4d8c
User Headers X LiteLLM Users Mapping feature (#14485) 
* Draft commit.

* user header mapping feature with backward compatibility with user_header_name field.

* user header mapping feature with backward compatibility with user_header_name field optimizations.

* Added unit tests.
 2025-09-12 11:49:37 -07:00
Fabrício Ceschin
dae5b0f0f3
Merge branch 'BerriAI:main' into LangfuseUsageDetails 2025-09-12 09:49:10 -04:00
Elias TOURNEUX
ef9d1ddc40
feat: Add OVHCloud AI Endpoints as a provider 2025-09-12 13:37:03 +02:00
rasmus.arpe@gmail.com
b8c362e443 add tests for the fix 2025-09-12 12:07:08 +02:00
Krish Dholakia
f8036a25a2
Merge pull request #14455 from lmnr-ai/fix/async-logging-tasks-context 
propagate execution context into logging tasks
 2025-09-12 00:36:08 -07:00
Krish Dholakia
113d2a8c5a
Merge pull request #14459 from holzman/fix-provider-budget 
Fix provider budgets
 2025-09-12 00:34:52 -07:00
Krish Dholakia
0413a701a2
Merge pull request #14460 from Sameerlite/litellm_vertex_gcs_bucket_issue 
fix vertex ai file upload
 2025-09-12 00:04:21 -07:00
Ishaan Jaff
32d87c242b
[Fixes] Using Qwen API Tiered Pricing (#14479) 
* fix: use dashscope cost calc

* add qwen logo
 2025-09-11 20:07:41 -07:00