Commit graph

1851 commits

Author SHA1 Message Date
Krish Dholakia
82d6c4d5b1
Merge branch 'main' into litellm_dev_08_31_2025_p1 2025-09-01 22:42:53 -07:00
Krish Dholakia
6d36219a4d
Merge pull request #14122 from BerriAI/litellm_dev_08_30_2025_p1
Braintrust - fix logging when OTEL is enabled + Gemini - add 'thoughtSignature' support via 'thinking_blocks'
2025-09-01 22:42:12 -07:00
TomeHirata
3f9ab84a7d Reapply "Add supported text field to anthropic citation response" 2025-09-02 14:36:55 +09:00
Ishaan Jaff
20811372d8 Revert "Merge pull request #14126 from TomeHirata/citation-supported-text-2"
This reverts commit 3f2881cd6d, reversing
changes made to 04f9ff16c4.
2025-09-01 20:24:14 -07:00
Krish Dholakia
3f2881cd6d
Merge pull request #14126 from TomeHirata/citation-supported-text-2
Add supported text field to anthropic citation response
2025-09-01 19:22:52 -07:00
Krish Dholakia
67450feb79
Merge pull request #14146 from ProjectAlita/gpt_5_unsupported_params
GPT-5: Drop unsupported params
2025-09-01 18:54:49 -07:00
Ishaan Jaff
4c7b3e10ed
[Bug Fix] Gemini Tool Calling - fix gemini empty enum property (#14155)
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY

* add _fix_enum_empty_strings

* test_tool_call_with_empty_enum_property

* test_fix_enum_empty_strings

* fix _fix_enum_empty_strings
2025-09-01 17:05:01 -07:00
Ishaan Jaff
2331fb45d5
[Bug]: Gemini 2.5 Pro – schema validation fails with OpenAI-style type arrays in tools (#14154)
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 16:53:20 -07:00
Byron Grogan
736bee813e fix: Support AWS_BEDROCK_RUNTIME_ENDPOINT on bedrock passthrough, make work for URLs with a base path 2025-09-01 17:47:26 -06:00
Sameer Kankute
c51665ec9c
fix xai cost calculation (#14127) 2025-09-01 11:31:56 -07:00
Ivan Krakhmaliuk
76dd9d8110 GPT-5: Test for unsupported params 2025-09-01 20:30:43 +03:00
Krish Dholakia
fd0f47d48d Merge pull request #14005 from moshemorad/bedrock_fix_structure_output
Bedrock fix structure output
2025-09-01 14:50:08 +03:00
TomeHirata
1ac7f875c9 fix test 2025-09-01 17:21:47 +09:00
TomeHirata
ca6d77b479 fix citation field name 2025-09-01 16:41:35 +09:00
onlylhf
bfed4e0a6a Add a complete URL generation method for embedding Volcengine API and optimize request and response processing logic; Delete redundant test files and refactor integration testing to improve readability and maintainability. 2025-09-01 13:18:19 +08:00
Krrish Dholakia
2ad77d9bf6 feat(ollama/completion): output parse thinking content on streaming + non-streaming for ollama completion calls
Completes 'thinking' param support for ollama
2025-08-31 21:17:10 -07:00
Dharamendra Kumar
4278c3b596 feat: Add dependency injection support to BaseLLMAIOHTTPHandler
- Add optional client_session, transport, and connector parameters to constructor
- Implement session ownership tracking to prevent closing user-provided sessions
- Add comprehensive session resolution hierarchy (dynamic > instance > create new)
- Include transport control for advanced HTTP stack management
- Add 29 comprehensive tests covering all injection scenarios
- Maintain backward compatibility with existing code

This enhancement allows users to inject their own configured aiohttp sessions,
transports, and connectors for fine-grained control over connection pooling,
SSL settings, proxy configurations, and other HTTP stack parameters.
2025-08-31 11:14:19 -07:00
Krrish Dholakia
b6f6dc5c1c feat(vertex_ai.py): support parsing thinking content into gemini format
allows function calls with thought signatures to be sent back to gemini

  Closes https://github.com/BerriAI/litellm/pull/13842
2025-08-30 18:49:34 -07:00
John Lathouwers
cf5a695571
Merge branch 'BerriAI:main' into main 2025-08-30 22:03:39 +01:00
gotsysdba
07d9d14b49
Update OCIResposeClass 2025-08-30 22:02:00 +01:00
Ishaan Jaff
34275ab273 Revert "Merge pull request #14005 from moshemorad/bedrock_fix_structure_output"
This reverts commit 75c327cb9e, reversing
changes made to afa687182a.
2025-08-30 13:37:10 -07:00
John Lathouwers
d137371026
Merge branch 'BerriAI:main' into main 2025-08-30 21:17:28 +01:00
gotsysdba
1ae5466daf
Test Case 2025-08-30 21:15:54 +01:00
Ishaan Jaff
7ff93cd1b1 Revert "Merge pull request #12865 from aholmberg/holmberg/default-reasoning"
This reverts commit 68f4847659, reversing
changes made to df39320889.
2025-08-30 13:07:33 -07:00
gotsysdba
a27604b67a
Fixes #14090 2025-08-30 20:57:57 +01:00
Krish Dholakia
8b11452d9e
Merge branch 'main' into add-vercel-ai-gateway-provider 2025-08-29 22:27:08 -07:00
Krish Dholakia
75c327cb9e
Merge pull request #14005 from moshemorad/bedrock_fix_structure_output
Bedrock fix structure output
2025-08-29 22:04:51 -07:00
frankzye1
75a7b39700 pass function tool description for databricks provider
Signed-off-by: frankzye1 <frankzye@qq.com>
2025-08-30 09:27:39 +08:00
Ishaan Jaff
607f425cc6
[Bug]: Fix Can't set reasoning_effort for DeepSeek-V3.1 on DeepInfra by default (#14053)
* fix DeepInfraConfig

* track supports reasoning

* fix: get_supported_openai_params

* test_deepseek_supported_openai_params
2025-08-29 13:15:43 -07:00
gotsysdba
15f1d82536
Fix tests 2025-08-28 14:54:38 +01:00
gotsysdba
87abfc3c11
Adding oci_key_file support for oci provider 2025-08-28 14:37:53 +01:00
TomuHirata
7333060fb0 feat(databricks): add anthropic citation support 2025-08-28 18:43:43 +09:00
Mohse Morad
8cce5e6307 Added tests 2025-08-28 12:21:35 +03:00
李海峰
2d0a57a719 Add Volcengine embedding module with handler and transformation logic
- Implemented VolcEngineEmbeddingHandler for synchronous and asynchronous embedding requests.
- Created VolcEngineEmbeddingConfig for transforming requests and responses to/from Volcengine format.
- Added integration tests for embedding functionality, covering various scenarios including error handling and parameter validation.
- Established test structure for Volcengine embedding, ensuring compliance with LiteLLM testing patterns.
- Included comprehensive tests for parameter mapping, request transformation, and response handling.
2025-08-28 15:05:11 +08:00
Krish Dholakia
74c9663189
Merge pull request #12797 from ericgtkb/fix-vertex-ai-anyof
Fix additional anyOf corner cases for Vertex AI Gemini tool calls - issue #11164
2025-08-27 22:26:13 -07:00
Krish Dholakia
fc738c5822
Merge branch 'main' into holmberg/default-reasoning 2025-08-27 22:25:22 -07:00
Krish Dholakia
c43706061f
Merge branch 'main' into heroku-llms 2025-08-27 22:21:36 -07:00
Krish Dholakia
a913ecf60b
Merge branch 'main' into feat/github-copilot-thinking-reasoning-support 2025-08-27 22:09:15 -07:00
Ishaan Jaff
4fff05f1cc
[Feature]: Support Gemini requests with only system prompt (#14010)
* _default_user_message_when_system_message_passed

* test_system_prompt_only_adds_blank_user_message

* test_system_message_with_no_user_message
2025-08-27 12:12:47 -07:00
Christoph Koehler
04cca1e7f3
feat: add image headers for Copilot
Fixes #13696. See issue for details.
2025-08-25 18:15:26 -06:00
Steven Anton
d95578464e Add support for AWS assume_role with a session token 2025-08-23 22:37:21 -07:00
Krish Dholakia
f0b0ee51e0
Merge branch 'main' into litellm_dev_08_15_2025_p1 2025-08-23 10:51:56 -07:00
Krish Dholakia
867b48a24f
Merge pull request #13866 from jinskjoy/Mistral-File-ID
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-22 23:54:17 -07:00
Krish Dholakia
dcad39c00f
Merge pull request #13753 from RichardoC/fix-bedrock-irsa-role-assumption
fix: role chaining and session name with webauthentication for aws bedrock
2025-08-22 07:20:27 -07:00
Krish Dholakia
8b45e53878
Merge pull request #13880 from datarobot-forks/carsongee/improve_datarobot_api_handling
🐛 Bug Fix: Updated URL handling for DataRobot provider URL
2025-08-21 23:18:40 -07:00
Carson Gee
b46de0ab5c
Updated URL handling for DataRobot provider base 2025-08-21 19:42:46 -06:00
Krish Dholakia
7c2c1c11d9
Merge pull request #13783 from philipkiely-baseten/main
Update Baseten LiteLLM integration
2025-08-21 18:34:36 -07:00
jinskjoy
d8a33e137d [Enhancement] Add support for Mistral model file handling and update documentation 2025-08-21 20:35:07 +02:00
Philip Kiely
5fa4a18073 add testing and remove redundant function 2025-08-21 11:25:26 -07:00
Krish Dholakia
1f84451925
Merge pull request #13803 from UlookEE/fix_bedrock_epc_acompletion
fix : Synchronize cache behavior between acompletion and completion
2025-08-20 22:38:30 -07:00