scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-08-28 05:25:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 8
43876 commits 3745 branches 1395 tags 3.9 GiB
Commit graph

971 commits

Author SHA1 Message Date
Ishaan Jaff
2cc85936ed
Revert "Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo" (#14362) 2025-09-08 18:40:54 -07:00
Ishaan Jaff
e37c1069a1 fix test images gemini 2025-09-08 17:22:59 -07:00
Krish Dholakia
9a62b9bdb9
Merge pull request #14161 from BerriAI/litellm_dev_09_01_2025_p2 
Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo
 2025-09-06 22:14:45 -07:00
Krish Dholakia
2716fa7981
Merge branch 'main' into litellm_dev_09_01_2025_p2 2025-09-06 19:03:25 -07:00
Krish Dholakia
a3ffc3060e
Merge branch 'main' into litellm_dev_09_01_2025_p1 2025-09-06 18:50:49 -07:00
Ishaan Jaff
0f26ec57d8 TestGroq 2025-09-06 18:19:09 -07:00
Ishaan Jaff
3b0aec2e5d test_azure_openai_gpt_5_responses_api 2025-09-06 17:47:01 -07:00
Krish Dholakia
d1adc7896d
Merge pull request #14262 from TobiMayr/feature/gemini-reasoning-effort-minimal 
feat: Add support for reasoning_effort='minimal' for Gemini models
 2025-09-06 09:17:23 -07:00
eycjur
58cf72ef5e add test 2025-09-06 21:12:18 +09:00
tobias-mayr
29bbde5257 fix condition ordering and test 2025-09-04 22:18:50 +01:00
Sameer Kankute
fc9560573b
[BUG] Fix response api for reasoning item in input for litellm proxy (#14200) 
* fix response api for litellm proxy

* Add test for checking if status is getting removed

* add test in correct file

* remove hardcoded fields

* Make the handling simpler

* fix lint error:
 2025-09-04 10:36:48 -07:00
katsuhiro muto
ca43514db4
[Feat] Support reasoning_effort in Groq (#14207) 
* Support reasoning_effort in groq

* add test
 2025-09-03 10:43:47 -07:00
TomuHirata
bb5127b8a0
Merge branch 'BerriAI:main' into citation-supported-text-3 2025-09-02 20:46:48 -10:00
Sameer Kankute
4adfd18bc6
[Feat]Add support for safety_identifier parameter in chat.completions.create (#14174) 
* Add support for safety_identifier parameter in chat.completions.create

* make sure param is getting actually passed to the raw api
 2025-09-02 09:37:08 -07:00
Krish Dholakia
6d36219a4d
Merge pull request #14122 from BerriAI/litellm_dev_08_30_2025_p1 
Braintrust - fix logging when OTEL is enabled + Gemini - add 'thoughtSignature' support via 'thinking_blocks'
 2025-09-01 22:42:12 -07:00
TomeHirata
4497dcf762 fix test 2025-09-02 14:39:19 +09:00
TomeHirata
3f9ab84a7d Reapply "Add supported text field to anthropic citation response" 2025-09-02 14:36:55 +09:00
Ishaan Jaff
20811372d8 Revert "Merge pull request #14126 from TomeHirata/citation-supported-text-2" 
This reverts commit 3f2881cd6d, reversing
changes made to 04f9ff16c4.
 2025-09-01 20:24:14 -07:00
Krrish Dholakia
271a14d3d1 test: remove hardcoded api base 2025-09-01 19:54:08 -07:00
Krish Dholakia
3f2881cd6d
Merge pull request #14126 from TomeHirata/citation-supported-text-2 
Add supported text field to anthropic citation response
 2025-09-01 19:22:52 -07:00
Krrish Dholakia
6a2da54fa8 test: update tests 2025-09-01 18:51:05 -07:00
Krrish Dholakia
d4cc748b40 feat(openrouter.py): add image generation via google on openrouter support 
Closes https://github.com/BerriAI/litellm/pull/14151
 2025-09-01 18:39:41 -07:00
Krrish Dholakia
4b8f2dc051 test: update tests 2025-09-01 18:20:46 -07:00
Krrish Dholakia
0fbcc01173 feat(types/utils.py): support 'images' field in output 
Compatible with Openrouter response format

 Closes https://github.com/BerriAI/litellm/pull/14151
 2025-09-01 18:05:16 -07:00
Ishaan Jaff
4c7b3e10ed
[Bug Fix] Gemini Tool Calling - fix gemini empty enum property (#14155) 
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY

* add _fix_enum_empty_strings

* test_tool_call_with_empty_enum_property

* test_fix_enum_empty_strings

* fix _fix_enum_empty_strings
 2025-09-01 17:05:01 -07:00
Ishaan Jaff
2331fb45d5
[Bug]: Gemini 2.5 Pro – schema validation fails with OpenAI-style type arrays in tools (#14154) 
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
 2025-09-01 16:53:20 -07:00
TomeHirata
e334f48699 Add supported text field to anthropic citation response 2025-09-01 16:46:54 +09:00
Krrish Dholakia
b6f6dc5c1c feat(vertex_ai.py): support parsing thinking content into gemini format 
allows function calls with thought signatures to be sent back to gemini

  Closes https://github.com/BerriAI/litellm/pull/13842
 2025-08-30 18:49:34 -07:00
Krrish Dholakia
51c73dc60b fix(vertex_and_google_ai_studio_gemini.py): bubble up thoughtsignature back to client 2025-08-30 17:26:18 -07:00
Ishaan Jaff
c9b86775a7 test_system_message_with_no_user_message 2025-08-30 13:09:25 -07:00
Ishaan Jaff
3cb8e23dfe Revert "Merge pull request #14026 from TomeHirata/citation-supported-text" 
This reverts commit afa687182a, reversing
changes made to 55186dad4c.
 2025-08-30 11:23:18 -07:00
Ishaan Jaff
dc6161535a fix for supports_reasoning check added in 68f4847659 2025-08-30 11:06:02 -07:00
Ishaan Jaff
3fc2198d27 fix: test_gemini_image_generation_async_stream 2025-08-30 10:33:23 -07:00
Ishaan Jaff
efebf7ec7b test_gemini_image_generation_async 2025-08-30 10:29:24 -07:00
Ishaan Jaff
fd39f22e3e test_completion_openrouter_reasoning_content 2025-08-30 09:27:37 -07:00
Krish Dholakia
afa687182a
Merge pull request #14026 from TomeHirata/citation-supported-text 
Add supported text field to anthropic citation response
 2025-08-29 22:02:18 -07:00
Ishaan Jaff
5ee7a675f2
[Bug]: grok-4 does not support frequency_penalty, litellm should drop this param for grok-4 (#14078) 
* fix: _supports_frequency_penalty

* _supports_frequency_penalty

* test_xai_grok_4_frequency_penalty_not_supported
 2025-08-29 17:31:48 -07:00
Oscar Craviotto
323cabb98d
fix: ensure Gemini calls include a user message (fixes #9733) 
When a Gemini model supports system messages, messages with the
system role get filtered out from the list of messages, so never
appended to the content (and passed as system_instructions instead).

This causes a 400 error, as both generateContent and streamGenerateContent
require contents (the systemInstruction object is optional).

This is a quick fix that does not check whether there was a system msg
or if the model supports it. It simply makes sure that if the list
of messages passed to  _gemini_convert_messages_with_history()
yields no contents, that there is at least a single (empty space)
user message set to prevent the call from failing.

The potential side effect of this is that we will not fail
a call lacking any message at all, but if that needs to be checked
(and AFAIU the OpenAI spec messages are required) it should be done
elsewhere (e.g. validate_and_fix_openai_messages() @ litellm/utils.py).

PS: Applied `make format` (`poetry run black [file changed]`) only to
files changed by me. The `make lint` command identified a bunch of
files requiring formatting that I am not modifying as I did not touch
them.
 2025-08-29 20:41:58 +03:00
Tomu Hirata
11228e946b add supported text field to anthropic citation response 2025-08-28 14:39:00 +09:00
Krish Dholakia
f01c7d13e7
Merge pull request #13991 from ikaadil/fix/gemini-imagen-model-name-validation 
[Bug Fix] Resolve invalid model name error for Gemini Imagen models
 2025-08-27 21:56:19 -07:00
Ishaan Jaff
04dc1a5351
[Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions (#13983) 
* add gemini-2.5-flash-image-preview

* add gemini-2.5-flash-image-preview

* add image in ChatCompletionResponseMessage

* test_gemini_image_generation_async

* Revert "Merge pull request #13394 from Deviad/feature/enhance_logging_for_containers"

This reverts commit 539b94ad4e, reversing
changes made to 71af7bcf9c.

* include `image` in Delta

* fix _process_candidates should show the image response

* fix: _handle_special_delta_attributes

* test_gemini_image_generation_async_stream

* image_generation_chat

* UI - allow looking at generated images from /chat/completions

* _create_streaming_choice

* fix import StreamingChoices

* fix ChatCompletionResponseMessage

* test_gemini_image_generation

* add gemini img migration

* fix _extract_candidate_metadata

* ui fix

* fix batch endpoint test
 2025-08-27 16:16:19 -07:00
Ifta Khairul Alam Adil
75aeca14b2 Merge branch 'main' into fix/gemini-imagen-model-name-validation 2025-08-27 21:52:47 +02:00
Ishaan Jaff
4fff05f1cc
[Feature]: Support Gemini requests with only system prompt (#14010) 
* _default_user_message_when_system_message_passed

* test_system_prompt_only_adds_blank_user_message

* test_system_message_with_no_user_message
 2025-08-27 12:12:47 -07:00
Ifta Khairul Alam Adil
0f5b31fd78 fix: resolve invalid model name error for Gemini Imagen models (#13851) 
- Fix URL construction in Gemini image generation to strip 'gemini/' prefix
- Google AI API expects base model name without the prefix
- Update model references and pricing information for consistency
- Remove outdated image generation pricing entries

Fixes issue where models like 'gemini/imagen-4.0-fast-generate-preview-06-06'
were being rejected by the Google AI API due to incorrect URL formatting.
 2025-08-27 04:17:35 +02:00
Steven Anton
d95578464e Add support for AWS assume_role with a session token 2025-08-23 22:37:21 -07:00
Ishaan Jaff
b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)

* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix

* create LoggingWorker

* add GLOBAL_LOGGING_WORKER for async task handling

* fix logging tests

* add conftest

* fix conftest

* test fix location of encode bedrock runtime modelid arn

* fix conftest.py

* tuning LoggingWorker

* conftest.py

* fix conftest batches/

* test_async_chat_azure

* event_loop

* test_bedrock_streaming_passthrough_test2

* fix GLOBAL_LOGGING_WORKER

* logging worker

* add flush for global logging worker

* Revert "fix GLOBAL_LOGGING_WORKER"

This reverts commit d254f508f4.

* fix conftest clear_queue

* fix conftest clear_queue

* setup_and_teardown for llm translation

* docs AWS_REGION

* test_async_chat_azure

* change test DIR

* run ci/cd again

* use 1 job for litellm_router_unit_testing

* fix space

* fix litellm_router_unit_testing

* test_aaarouter_dynamic_cooldown_message_retry_time

* litellm_router_unit_testing

* conftest.py clearing qu

* fixes litellm_router_unit_testing

* fixes clear_queue

* fix router_unit_tests

* remove conftest

* add back conftest for router

* fix event loop test

* test fix

* fixes for LoggingWorker

* ruff fix
 2025-08-23 13:13:23 -07:00
Krrish Dholakia
4d7433b5ad test: reduce mistral direct tests b/c of rate limit errors 2025-08-23 11:15:03 -07:00
Krish Dholakia
f0b0ee51e0
Merge branch 'main' into litellm_dev_08_15_2025_p1 2025-08-23 10:51:56 -07:00
Krish Dholakia
9c4a86e98e
Merge pull request #13868 from kankute-sameer/litellm_feat_voyage_context_3_embedding_model 
[Feat] Add support for voyage-context-3 embedding model
 2025-08-21 23:18:20 -07:00
Ishaan Jaff
e93e266f84
[Performance] Use O(1) Set lookups for model routing (#13879) 
* o(1) lookups

* Revert "o(1) lookups"

This reverts commit 620d142469.

* o(1) lookups

* Revert "o(1) lookups"

This reverts commit 676a9f5bcc.

* o(1) lookups

* register_model fix

* test_aget_valid_models

* lambda ai models fix

* test_utils.py

* test fix vertex ai
 2025-08-21 22:56:46 -07:00