eycjur
58cf72ef5e
add test
2025-09-06 21:12:18 +09:00
tobias-mayr
29bbde5257
fix condition ordering and test
2025-09-04 22:18:50 +01:00
Sameer Kankute
fc9560573b
[BUG] Fix response api for reasoning item in input for litellm proxy ( #14200 )
...
* fix response api for litellm proxy
* Add test for checking if status is getting removed
* add test in correct file
* remove hardcoded fields
* Make the handling simpler
* fix lint error:
2025-09-04 10:36:48 -07:00
katsuhiro muto
ca43514db4
[Feat] Support reasoning_effort in Groq ( #14207 )
...
* Support reasoning_effort in groq
* add test
2025-09-03 10:43:47 -07:00
TomuHirata
bb5127b8a0
Merge branch 'BerriAI:main' into citation-supported-text-3
2025-09-02 20:46:48 -10:00
Sameer Kankute
4adfd18bc6
[Feat]Add support for safety_identifier parameter in chat.completions.create ( #14174 )
...
* Add support for safety_identifier parameter in chat.completions.create
* make sure param is getting actually passed to the raw api
2025-09-02 09:37:08 -07:00
Krish Dholakia
6d36219a4d
Merge pull request #14122 from BerriAI/litellm_dev_08_30_2025_p1
...
Braintrust - fix logging when OTEL is enabled + Gemini - add 'thoughtSignature' support via 'thinking_blocks'
2025-09-01 22:42:12 -07:00
TomeHirata
4497dcf762
fix test
2025-09-02 14:39:19 +09:00
TomeHirata
3f9ab84a7d
Reapply "Add supported text field to anthropic citation response"
2025-09-02 14:36:55 +09:00
Ishaan Jaff
20811372d8
Revert "Merge pull request #14126 from TomeHirata/citation-supported-text-2"
...
This reverts commit 3f2881cd6d04f9ff16c4
2025-09-01 20:24:14 -07:00
Krrish Dholakia
271a14d3d1
test: remove hardcoded api base
2025-09-01 19:54:08 -07:00
Krish Dholakia
3f2881cd6d
Merge pull request #14126 from TomeHirata/citation-supported-text-2
...
Add supported text field to anthropic citation response
2025-09-01 19:22:52 -07:00
Krrish Dholakia
6a2da54fa8
test: update tests
2025-09-01 18:51:05 -07:00
Krrish Dholakia
d4cc748b40
feat(openrouter.py): add image generation via google on openrouter support
...
Closes https://github.com/BerriAI/litellm/pull/14151
2025-09-01 18:39:41 -07:00
Krrish Dholakia
4b8f2dc051
test: update tests
2025-09-01 18:20:46 -07:00
Krrish Dholakia
0fbcc01173
feat(types/utils.py): support 'images' field in output
...
Compatible with Openrouter response format
Closes https://github.com/BerriAI/litellm/pull/14151
2025-09-01 18:05:16 -07:00
Ishaan Jaff
4c7b3e10ed
[Bug Fix] Gemini Tool Calling - fix gemini empty enum property ( #14155 )
...
* fix: _convert_schema_types
* fix recursive detector
* test_convert_schema_types_type_array_conversion
* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
* add _fix_enum_empty_strings
* test_tool_call_with_empty_enum_property
* test_fix_enum_empty_strings
* fix _fix_enum_empty_strings
2025-09-01 17:05:01 -07:00
Ishaan Jaff
2331fb45d5
[Bug]: Gemini 2.5 Pro – schema validation fails with OpenAI-style type arrays in tools ( #14154 )
...
* fix: _convert_schema_types
* fix recursive detector
* test_convert_schema_types_type_array_conversion
* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 16:53:20 -07:00
TomeHirata
e334f48699
Add supported text field to anthropic citation response
2025-09-01 16:46:54 +09:00
Krrish Dholakia
b6f6dc5c1c
feat(vertex_ai.py): support parsing thinking content into gemini format
...
allows function calls with thought signatures to be sent back to gemini
Closes https://github.com/BerriAI/litellm/pull/13842
2025-08-30 18:49:34 -07:00
Krrish Dholakia
51c73dc60b
fix(vertex_and_google_ai_studio_gemini.py): bubble up thoughtsignature back to client
2025-08-30 17:26:18 -07:00
Ishaan Jaff
c9b86775a7
test_system_message_with_no_user_message
2025-08-30 13:09:25 -07:00
Ishaan Jaff
3cb8e23dfe
Revert "Merge pull request #14026 from TomeHirata/citation-supported-text"
...
This reverts commit afa687182a55186dad4c
2025-08-30 11:23:18 -07:00
Ishaan Jaff
dc6161535a
fix for supports_reasoning check added in 68f4847659
2025-08-30 11:06:02 -07:00
Ishaan Jaff
3fc2198d27
fix: test_gemini_image_generation_async_stream
2025-08-30 10:33:23 -07:00
Ishaan Jaff
efebf7ec7b
test_gemini_image_generation_async
2025-08-30 10:29:24 -07:00
Ishaan Jaff
fd39f22e3e
test_completion_openrouter_reasoning_content
2025-08-30 09:27:37 -07:00
Krish Dholakia
afa687182a
Merge pull request #14026 from TomeHirata/citation-supported-text
...
Add supported text field to anthropic citation response
2025-08-29 22:02:18 -07:00
Ishaan Jaff
5ee7a675f2
[Bug]: grok-4 does not support frequency_penalty, litellm should drop this param for grok-4 ( #14078 )
...
* fix: _supports_frequency_penalty
* _supports_frequency_penalty
* test_xai_grok_4_frequency_penalty_not_supported
2025-08-29 17:31:48 -07:00
Oscar Craviotto
323cabb98d
fix: ensure Gemini calls include a user message ( fixes #9733 )
...
When a Gemini model supports system messages, messages with the
system role get filtered out from the list of messages, so never
appended to the content (and passed as system_instructions instead).
This causes a 400 error, as both generateContent and streamGenerateContent
require contents (the systemInstruction object is optional).
This is a quick fix that does not check whether there was a system msg
or if the model supports it. It simply makes sure that if the list
of messages passed to _gemini_convert_messages_with_history()
yields no contents, that there is at least a single (empty space)
user message set to prevent the call from failing.
The potential side effect of this is that we will not fail
a call lacking any message at all, but if that needs to be checked
(and AFAIU the OpenAI spec messages are required) it should be done
elsewhere (e.g. validate_and_fix_openai_messages() @ litellm/utils.py).
PS: Applied `make format` (`poetry run black [file changed]`) only to
files changed by me. The `make lint` command identified a bunch of
files requiring formatting that I am not modifying as I did not touch
them.
2025-08-29 20:41:58 +03:00
Tomu Hirata
11228e946b
add supported text field to anthropic citation response
2025-08-28 14:39:00 +09:00
Krish Dholakia
f01c7d13e7
Merge pull request #13991 from ikaadil/fix/gemini-imagen-model-name-validation
...
[Bug Fix] Resolve invalid model name error for Gemini Imagen models
2025-08-27 21:56:19 -07:00
Ishaan Jaff
04dc1a5351
[Feat] Add support for returning images with gemini/gemini-2.5-flash-image-preview with /chat/completions ( #13983 )
...
* add gemini-2.5-flash-image-preview
* add gemini-2.5-flash-image-preview
* add image in ChatCompletionResponseMessage
* test_gemini_image_generation_async
* Revert "Merge pull request #13394 from Deviad/feature/enhance_logging_for_containers"
This reverts commit 539b94ad4e71af7bcf9c
2025-08-27 16:16:19 -07:00
Ifta Khairul Alam Adil
75aeca14b2
Merge branch 'main' into fix/gemini-imagen-model-name-validation
2025-08-27 21:52:47 +02:00
Ishaan Jaff
4fff05f1cc
[Feature]: Support Gemini requests with only system prompt ( #14010 )
...
* _default_user_message_when_system_message_passed
* test_system_prompt_only_adds_blank_user_message
* test_system_message_with_no_user_message
2025-08-27 12:12:47 -07:00
Ifta Khairul Alam Adil
0f5b31fd78
fix: resolve invalid model name error for Gemini Imagen models ( #13851 )
...
- Fix URL construction in Gemini image generation to strip 'gemini/' prefix
- Google AI API expects base model name without the prefix
- Update model references and pricing information for consistency
- Remove outdated image generation pricing entries
Fixes issue where models like 'gemini/imagen-4.0-fast-generate-preview-06-06'
were being rejected by the Google AI API due to incorrect URL formatting.
2025-08-27 04:17:35 +02:00
Steven Anton
d95578464e
Add support for AWS assume_role with a session token
2025-08-23 22:37:21 -07:00
Ishaan Jaff
b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS ( #13905 )
...
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895 )
* fix: litellm.configured_cold_storage_logger
* fix Session Management - Non-OpenAI Models docs
* ruff fix
* test fix
* create LoggingWorker
* add GLOBAL_LOGGING_WORKER for async task handling
* fix logging tests
* add conftest
* fix conftest
* test fix location of encode bedrock runtime modelid arn
* fix conftest.py
* tuning LoggingWorker
* conftest.py
* fix conftest batches/
* test_async_chat_azure
* event_loop
* test_bedrock_streaming_passthrough_test2
* fix GLOBAL_LOGGING_WORKER
* logging worker
* add flush for global logging worker
* Revert "fix GLOBAL_LOGGING_WORKER"
This reverts commit d254f508f4
2025-08-23 13:13:23 -07:00
Krrish Dholakia
4d7433b5ad
test: reduce mistral direct tests b/c of rate limit errors
2025-08-23 11:15:03 -07:00
Krish Dholakia
f0b0ee51e0
Merge branch 'main' into litellm_dev_08_15_2025_p1
2025-08-23 10:51:56 -07:00
Krish Dholakia
9c4a86e98e
Merge pull request #13868 from kankute-sameer/litellm_feat_voyage_context_3_embedding_model
...
[Feat] Add support for voyage-context-3 embedding model
2025-08-21 23:18:20 -07:00
Ishaan Jaff
e93e266f84
[Performance] Use O(1) Set lookups for model routing ( #13879 )
...
* o(1) lookups
* Revert "o(1) lookups"
This reverts commit 620d142469676a9f5bcc
2025-08-21 22:56:46 -07:00
Sameer Kankute
5ac4fb512c
Add support for voyage-context-3 embedding model
2025-08-22 00:15:12 +05:30
Krish Dholakia
422447b7f1
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses
...
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
2025-08-18 18:59:28 -07:00
Ishaan Jaff
ba0881d728
[Bug Fix] image_edit() function returns APIConnectionError with litellm_proxy - Support for both image edits and image generations ( #13735 )
...
* add image edits litellm proxy on SDK
* add image gen provider
* add IMG Gen support for litellm_proxy provider
2025-08-18 18:26:32 -07:00
Krrish Dholakia
ff7bdb6290
fix(mistral/chat/transformation.py): handle empty message content for mistral calls
...
Fixes https://github.com/BerriAI/litellm/issues/13355
2025-08-16 00:41:11 -07:00
Krrish Dholakia
b83b1686c2
feat(support-allowed_openai_params-for-responses-api): Fixes https://github.com/BerriAI/litellm/issues/13559
2025-08-16 00:23:37 -07:00
Jugal D. Bhatt
aea0605eed
[LLM Translation] Fix Realtime API endpoint for no intent ( #13476 )
...
* fix intent params
* Add responses
* fix unrelated test
* test fix - fireworks API endpoint is down
* test fix fireworks ai is having an active outage
* test_completion_cost_databricks
* dbrx fix test API currently not responding
* Update OpenAI Realtime handler to use the correct endpoint and include all query parameters. Adjusted error messages for missing API base and key. Updated health check URL construction to pass model as a query parameter.
* Enhance OpenAI Realtime handler tests to ensure model parameter inclusion in WebSocket URL. Added new tests to verify correct URL construction with model and additional parameters, preventing 'missing_model' errors. Updated existing tests for consistency.
* Remove debug print statements for API base and key in OpenAIRealtime handler to clean up the code.
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-08-14 16:24:14 -07:00
Krish Dholakia
f00e891004
LiteLLM SDK <-> Proxy: support user param + Prisma - remove use_prisma_migrate flag - redundant as this is now default ( #13555 )
...
* fix(litellm_proxy/chat/transformation.py): support 'user' and all other openai chat completion params
Fixes issue where 'user' was not being sent in request to litellm proxy via sdk
* fix(prisma_migration.py): remove 'use_prisma_migrate' flag, is now default
* docs: cleanup docs
* fix(proxy_cli.py): remove --use_prisma_migrate flag
* refactor: remove references to use_prisma_migrate env var
This is now the default flow for db migrations
2025-08-12 22:03:39 -07:00
Ishaan Jaff
828e3e3deb
[Feat] Add Streaming support + Docs for bedrock gpt-oss model family ( #13346 )
...
* add openai.gpt-oss-20b-1:0
* update BEDROCK_CONVERSE_MODELS
* openai.gpt-oss-20b-1:0 fixes
* fix PDF input
* fix for should_fake_stream
* TestBedrockGPTOSS
* should_fake_stream
* update supports vision field for openai.gpt-oss models
* fixes for bedrock gpt oss
* fixes for should_fake_stream
* docs bedrock gpt oss models
2025-08-12 08:39:36 -07:00
