scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-09 03:18:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 108
29986 commits 3347 branches 1448 tags 5 GiB
Commit graph

5260 commits

Author SHA1 Message Date
Ishaan Jaff
b4f45e838a add test 2025-07-04 10:06:40 -07:00
Ishaan Jaff
ab13edd155 check_for_litellm_module_deletion 2025-07-04 10:06:40 -07:00
Ishaan Jaff
39955129f5
fix mapped tests (#12320) 
* fix - use flush llm client cache

* faster mapped tests

* test_async_multiple_response_ids_routing

* fix tests

* test_ateam_member_update_admin_requires_premium

* regular mapped tests

* Revert "Fix: Initialize JSON logging for all loggers when JSON_LOGS=True (#12206)"

This reverts commit 2c60c316ec.

* reset num workers
 2025-07-04 10:04:43 -07:00
Low Jian Sheng
c2d5682a90
Fix gemini tool call sequence (#11999) 
* fix gemini tool call sequence

* modify tests
 2025-07-04 07:29:39 -07:00
Ishaan Jaff
d774b08766 test_arouter_filter_team_based_models 2025-07-03 23:05:03 -07:00
Krish Dholakia
a03390ccc7
Litellm dev 07 03 2025 p2 (#12301) 
* fix(langfuse_prompt_management.py): add langfuse prompt version param support

Adds prompt versioning support

* test(test_langfuse_prompt_management.py): add unit test

* fix: fix linting errors

* fix: add prompt_version instrumentation

* fix(langfuse_otel.py): correctly read env var

* docs(langfuse_integration.md): clarify v3 recommendation is to use langfuse_otel

Closes https://github.com/BerriAI/litellm/issues/11500

* docs(langfuse_otel_integration.md): cleanup docs

* test: fix test

* test: update tests

* fix: fix linting error
 2025-07-03 22:40:21 -07:00
Ishaan Jaff
467dc4fa38 test router 2025-07-03 22:37:25 -07:00
Ishaan Jaff
7319d6b003 test llamafile 2025-07-03 22:35:22 -07:00
Ishaan Jaff
0835011388 test fix creds test 2025-07-03 22:01:52 -07:00
Cole McIntosh
b6589a72c9
fix: Add size parameter support for Vertex AI image generation (#12292) 
- Added 'size' to supported parameters for vertex_ai in get_optional_params_image_gen
- Implemented mapping from OpenAI size format (e.g., '1024x1024') to Vertex AI aspectRatio format (e.g., '1:1')
- Supports common aspect ratios: 1:1 (square), 16:9 (landscape), 9:16 (portrait)
- Added comprehensive test coverage for the size parameter mapping

Fixes LIT-279: Vertex AI Image Generation Aspect Ratio Support
 2025-07-03 21:43:37 -07:00
Ishaan Jaff
9c8619ed10 test fix 2025-07-03 21:16:26 -07:00
Ishaan Jaff
81d96b9ffe fix test models 2025-07-03 21:16:26 -07:00
Krish Dholakia
f755b70528
fix(factory.py): support optional args for bedrock (#12287) 
* fix(factory.py): support optional args for bedrock

Closes https://github.com/BerriAI/litellm/pull/12276

* test(main.py): Support async await on mock_delay

Closes https://github.com/BerriAI/litellm/issues/12282
 2025-07-03 21:15:10 -07:00
Ishaan Jaff
bffe5bec7d test fix cli credentials 2025-07-03 21:08:35 -07:00
Ishaan Jaff
e03686de5f tests fix use correct import responses 2025-07-03 21:06:31 -07:00
Ishaan Jaff
4293dd2c2a
test: stabilize credentials CLI patch (#12305) 2025-07-03 18:09:32 -07:00
Ishaan Jaff
3ad6b36ffc
test: patch CredentialsManagementClient in CLI (#12304) 2025-07-03 17:01:50 -07:00
Ishaan Jaff
e7374e3909 test_gemini_url_context 2025-07-03 16:13:44 -07:00
Ishaan Jaff
59f3771799 test_text_completion_stream - hf 2025-07-03 16:00:51 -07:00
Ishaan Jaff
782ba9f5a0 sys.path.insert for cli tests 2025-07-03 15:58:49 -07:00
Ishaan Jaff
81948d4198 fix test 2025-07-03 15:37:10 -07:00
Ishaan Jaff
e75f4c8561 TestCallbackManagementEndpoints 2025-07-03 15:00:53 -07:00
Ishaan Jaff
437f4765b4 test_completion_mistral_api_mistral_large_function_call_with_streaming 2025-07-03 14:58:28 -07:00
Ishaan Jaff
274baac9df test_mcp_tools_with_responses_api 2025-07-03 14:53:30 -07:00
Cole McIntosh
adfe63cf3a
fix: handle proxy internal callbacks in callback management test (#12294) 
The test_list_callbacks_mixed_callback_types test was failing when run in parallel with other tests due to the proxy server's internal _PROXY_VirtualKeyModelMaxBudgetLimiter callback persisting across test runs. This fix filters out proxy internal callbacks from the test assertions to ensure consistent test behavior regardless of test execution order or parallelization.
 2025-07-03 14:28:46 -07:00
Ishaan Jaff
03a589d323 fix - MCP deepwiki mcp is unstable, move to stable mcp 2025-07-03 14:24:32 -07:00
Ishaan Jaff
3387029723
[Bug Fix] Using gemini-cli with Vertex Anthropic Models (#12246) 
* add is_vertex_partner_model

* fixes for get_provider_google_genai_generate_content_config

* bug fix use vertex anthropic models with gemini cli

* vertex_anthropic_mock_response

* test streaming vertex generateContent

* add unified_google_tests

* fix is_vertex_partner_model

* add load_vertex_ai_credentials

* test fix
 2025-07-03 12:29:27 -07:00
Krish Dholakia
c0319d0d01 Litellm dev fix gemini web search tracking (#12288) 
* feat(stream_chunk_builder_utils.py): correctly return web_search_requests on stream chunk builder

* fix(types/utils.py): handle prompttokendetails

* fix(stream_chunk_builder_utils.py): fix ruff check error

* test: try-except rate limit error

* fix: fix import
 2025-07-03 12:27:14 -07:00
Ishaan Jaff
75bb22a868 fix huggingface/deepseek-ai/DeepSeek-R1 2025-07-03 12:13:51 -07:00
Ishaan Jaff
5630147e80 Revert "Revert "fix tests (#12286)"" 
This reverts commit 12f157513b.
 2025-07-03 12:08:27 -07:00
Ishaan Jaff
12f157513b Revert "fix tests (#12286)" 
This reverts commit 99ce3a24cc.
 2025-07-03 12:04:23 -07:00
Ishaan Jaff
9cc144e3cb test add clear_existing_callbacks 2025-07-03 12:00:36 -07:00
Jugal D. Bhatt
df161f1e45
Litellm mcp tool prefix (#12289) 
* prefix all server tools from the backend

* change var name

* fix tests
 2025-07-03 11:39:37 -07:00
Ishaan Jaff
96d5f891df fix test 2025-07-03 11:18:41 -07:00
Ishaan Jaff
ba5af3e44b fix keys delete 2025-07-03 11:18:10 -07:00
célina
99ce3a24cc
fix tests (#12286) 2025-07-03 10:57:19 -07:00
Krrish Dholakia
82a0a443c6 feat(stream_chunk_builder_utils.py): correctly return web_search_requests on stream chunk builder 2025-07-03 10:56:26 -07:00
Ishaan Jaff
c3909d6f50 test_keys_delete_error_handling 2025-07-03 10:04:59 -07:00
dcieslak19973
d480cea8b0
Add azure_ai cohere rerank v3.5 (#12283) 
* Add azure_ai cohere rerank v3.5

* Fix CI error
 2025-07-03 10:01:45 -07:00
Ishaan Jaff
282ce1a859 test - fix delete keys 2025-07-02 22:23:10 -07:00
Krish Dholakia
42cd05dee8
Add Azure Content Safety Guardrails to LiteLLM proxy (#12268) 
* feat(azure/prompt_shield.py): initial commit adding prompt shield guardrail + auto discovery mechanism for guardrails

reduces amount of code needed outside of guardrail integration for instrumentation

* feat(azure/prompt_shield.py): working azure prompt shield guardrail integration

Addresses https://github.com/BerriAI/litellm/issues/12254

* test: unit tests for prompt_shield

* fix(prompt_shield.py): add event hook validation for prompt shield guardrail

ensures prompt shield guardrail raises error if asked to run post_call (only runs on user prompt)

* feat(azure/): working text_moderation integration

* fix(text_moderation.py): suppress linting error

* test(test_azure_text_moderation.py): add unit test

* test(test_azure_text_moderation.py): add unit test for responses

* fix(text_moderation.py): return streaming error correctly

ensures error returned to user

* fix: fix linting error

* fix: fix linting check

* test: change mistral model

service tier exceeded

* fix(exception_mapping_utils.py): cover mistral in exception mapping
 2025-07-02 21:34:19 -07:00
Krrish Dholakia
a198d4a39f test: change mistral model 
service tier exceeded
 2025-07-02 21:11:02 -07:00
Ishaan Jaff
1aa55e6a74 test_url_context 2025-07-02 21:10:12 -07:00
Krish Dholakia
bba75aa12b
Add 'audio_url' message type support for VLLM (#12270) 
* fix(openai.py): add audio_url content type for vllm

Fixes https://github.com/BerriAI/litellm/issues/12196

* test: fix test
 2025-07-02 20:37:45 -07:00
Jugal D. Bhatt
5fe01b9a2b
Add MCP servers header to the scope of header (#12266) 
* add mcp header param

* rename class

* fix tests

* fix tests

* added ruff fixes

* fix ruff checks

* added mypy type checking
 2025-07-02 20:22:14 -07:00
Ishaan Jaff
eef0623443
[Feat] Add Arize Team Based Logging (#12264) 
* working KeyAndTeamLoggingSettings

* add arize_space_id to StandardCallbackDynamicParams

* add construct_dynamic_arize_headers

* add construct_dynamic_arize_headers to

* update otel arize logging

* fix imports

* test_construct_dynamic_arize_headers

* dynamic key/team settings

* test_get_dynamic_logging_metadata_with_arize_team_logging
 2025-07-02 17:15:35 -07:00
Jugal D. Bhatt
5a852ca647
Add fix to tests (#12263) 2025-07-02 16:57:49 -07:00
Jugal D. Bhatt
d55712b783
Add MCP url masking on frontend (#12247) 
* add url masking on frontend

* fix test

* add signature
 2025-07-02 16:32:26 -07:00
Jugal D. Bhatt
88834b8550
[Bump] Litellm responses format (#12253) 
* Add responses format changes

* Add check

* Add check

* added more testing
 2025-07-02 16:32:06 -07:00
Ishaan Jaff
bc368707df
[Bug Fix] Fixes for bedrock guardrails post_call - applying to streaming responses (#12252) 
* fixes for using bedrock guard

* fixes for output_content_bedrock guard

* test_convert_to_bedrock_format_input_source

* test_convert_to_bedrock_format_post_call_streaming_hook

* test bedrock guard
 2025-07-02 14:46:27 -07:00