Commit graph

8121 commits

Author SHA1 Message Date
Sameer Kankute
f7f106f8b8 Move test to test_litellm/ folder 2025-09-05 10:00:58 +05:30
Krish Dholakia
f67339a86c
Merge pull request #14028 from onlylhf/volcengine-embedding-support
Add Volcengine embedding module with handler and transformation logic
2025-09-04 21:01:25 -07:00
Krish Dholakia
62d4623d1c
Merge pull request #14107 from uc4w6c/feat/add_guardrails_anthropic
feat: Add guardrail to the Anthropic API endpoint
2025-09-04 20:50:43 -07:00
Krish Dholakia
5d5c19a302
Merge pull request #14077 from TomeHirata/codex/add-support-for-anthropic-citation-api
Add support for anthropic citation api in Databricks
2025-09-04 20:46:11 -07:00
Ishaan Jaff
379b0dbf14
[Fix] Ensure team_id is a required field for generating service account keys (#14270)
* generate_service_account_key_fn

* fix validate_team_id_used_in_service_account_request

* fix types

* test_validate_team_id_used_in_service_account_request_requires_team_id
2025-09-04 18:14:38 -07:00
Ishaan Jaff
1352545617
[Fix] DD LLM Observability - Ensure apm_id is set on traces (#14272)
* add apm_id for DD LLM

* feat: add _get_apm_trace_id
2025-09-04 14:35:41 -07:00
Krish Dholakia
796192dabe
Merge pull request #14130 from moshemorad/bedrock_fix_structure_output
Bedrock fix structure output
2025-09-04 12:22:35 -07:00
Krish Dholakia
e7b4892124
Merge pull request #14156 from byrongrogan/byron--bedrock-passthrough-override
fix: Support AWS_BEDROCK_RUNTIME_ENDPOINT on bedrock passthrough, make work for URLs with a base path
2025-09-04 12:20:17 -07:00
Sameer Kankute
fc9560573b
[BUG] Fix response api for reasoning item in input for litellm proxy (#14200)
* fix response api for litellm proxy

* Add test for checking if status is getting removed

* add test in correct file

* remove hardcoded fields

* Make the handling simpler

* fix lint error:
2025-09-04 10:36:48 -07:00
Sameer Kankute
5f79e8aac6
Litellm passthrough cost tracking chat completion (#14256)
* feat: add structured output for sdk

* Add support for cost tracking for chat completion in passthrough

* remove not required changes
2025-09-04 09:57:48 -07:00
Ishaan Jaff
1237be04a5 test_aaamodel_prices_and_context_window_json_is_valid 2025-09-04 07:58:20 -07:00
Krish Dholakia
a8cce5fbf3
Merge pull request #14237 from yeahyung/fix/tpm_limit_bug
Fixes #14204 TPM Rate Limit Bug
2025-09-04 07:29:47 -07:00
22mSqRi
25afa67616 fix: Key Budget not resets at expectable times 2025-09-04 09:04:01 +00:00
yeahyung
7829de2948 (#14204) add test code 2025-09-04 16:41:29 +09:00
Ishaan Jaff
23ae7170d1
[Feat] Allow using Veo Video Generation through LiteLLM Pass through routes (#14228)
* fix: add follow_redirects=True,

* test_pass_through_with_httpbin_redirect

* cook book veo video

* docs Veo Video Generation with Google AI Studio

* add veo-3.0-generate-preview cost tracking details

* track vertex_video_models
2025-09-03 18:25:43 -07:00
Ishaan Jaff
be7c762882 add video_generation 2025-09-03 18:25:27 -07:00
Ishaan Jaff
beb300abae
[Fix] SCIM - Bug fixes for handling SCIM Group Memberships (#14226)
* Feat: add better SCIM debugging

* fix _get_scim_member_display

* fix patch_group

* test_update_group_e2e

* test_get_scim_member_value
2025-09-03 16:15:51 -07:00
TomuHirata
bb5127b8a0
Merge branch 'BerriAI:main' into citation-supported-text-3 2025-09-02 20:46:48 -10:00
Ishaan Jaff
63c4a30564 TestVertexAIGPTOSSTransformation 2025-09-02 23:07:52 -07:00
Krish Dholakia
35b501b8d5
Merge pull request #14176 from mjmendo/feat/alert_type_in_slack_message
feat: added alert type to alert messate to slack for easier handling
2025-09-02 23:05:41 -07:00
Krish Dholakia
dc0d2a44a5
Merge pull request #14171 from kutsushitaneko/fix/14158_tool_call_id
fix(oci): Handle assistant messages with both content and tool_calls in OCI provider (#14158)
2025-09-02 23:05:04 -07:00
Krish Dholakia
c8b177963e
Merge pull request #14191 from kayoch1n/fix-h11-model-name
Remove "/" or ":" from model name when being used as h11 header name
2025-09-02 23:02:45 -07:00
kayoch1n
76555cad81 Format code 2025-09-03 11:20:52 +08:00
kayoch1n
ffbe5cd899 Add a testcase 2025-09-03 11:08:23 +08:00
Krish Dholakia
46655544a4
Merge pull request #14179 from zhirafovod/otel_logs_metrics 2025-09-02 19:50:40 -07:00
Ishaan Jaff
128d9a3488
[Feature]: Add header support for spend_logs_metadata (#14186)
* fix: allow settings spend_logs_metadata

* fix add_litellm_data_for_backend_llm_call

* fix: add add_litellm_metadata_from_request_headers

* fix add_litellm_metadata_from_request_headers

* test_add_litellm_metadata_from_request_headers

* add_litellm_metadata_from_request_headers

* docs Tracking Spend with custom metadata

* add_litellm_metadata_from_request_headers

* add_litellm_metadata_from_request_headers
2025-09-02 15:13:15 -07:00
Ishaan Jaff
c821f1ddf1
[Feature]: Support GPT-OSS models on vertex ai (#14184)
* add VertexAIGPTOSSTransformation

* fix: optional_params

* fix: is_vertex_partner_model

* test_partner_models_httpx

* docs GPT oss docs

* test_vertex_ai_gpt_oss_reasoning_effort

* add vertex ai models
2025-09-02 14:15:26 -07:00
Marcelo Mendoza
db1b418b15 fix: update alert type formatting to handle enum names in Slack messages 2025-09-02 17:54:54 +02:00
Keith Decker
5dcdbb35da add metrics and logs (events) with semconv attributes 2025-09-02 09:20:25 -06:00
Marcelo Mendoza
92f631d57c fix: correct formatting of alert messages in Slack notifications 2025-09-02 15:12:11 +00:00
Ishaan Jaff
61b2209827 test_proxy_function_calling_support_consistency 2025-09-02 07:22:52 -07:00
John Lathouwers
d02e560d85
Merge branch 'BerriAI:main' into main 2025-09-02 12:46:37 +01:00
Yuji Arakawa
c7109609fd renamed unit test code 2025-09-02 19:11:37 +09:00
Yuji Arakawa
ae3931f5f3 FIx https://github.com/BerriAI/litellm/issues/14158 2025-09-02 18:32:45 +09:00
Krish Dholakia
82d6c4d5b1
Merge branch 'main' into litellm_dev_08_31_2025_p1 2025-09-01 22:42:53 -07:00
Krish Dholakia
6d36219a4d
Merge pull request #14122 from BerriAI/litellm_dev_08_30_2025_p1
Braintrust - fix logging when OTEL is enabled + Gemini - add 'thoughtSignature' support via 'thinking_blocks'
2025-09-01 22:42:12 -07:00
Krish Dholakia
d2c519f005
Merge pull request #14133 from retanoj/fix/gemini-token-count
Fix token count error for gemini cli
2025-09-01 22:39:51 -07:00
TomeHirata
3f9ab84a7d Reapply "Add supported text field to anthropic citation response" 2025-09-02 14:36:55 +09:00
Ishaan Jaff
20811372d8 Revert "Merge pull request #14126 from TomeHirata/citation-supported-text-2"
This reverts commit 3f2881cd6d, reversing
changes made to 04f9ff16c4.
2025-09-01 20:24:14 -07:00
Ishaan Jaff
d37be48a80 test: llama-3.3-70b-versatile 2025-09-01 20:14:12 -07:00
Krish Dholakia
3f2881cd6d
Merge pull request #14126 from TomeHirata/citation-supported-text-2
Add supported text field to anthropic citation response
2025-09-01 19:22:52 -07:00
Krish Dholakia
67450feb79
Merge pull request #14146 from ProjectAlita/gpt_5_unsupported_params
GPT-5: Drop unsupported params
2025-09-01 18:54:49 -07:00
Krrish Dholakia
4a422ca897 fix: support logging dynamic metadata values to braintrust 2025-09-01 17:38:15 -07:00
Ishaan Jaff
4c7b3e10ed
[Bug Fix] Gemini Tool Calling - fix gemini empty enum property (#14155)
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY

* add _fix_enum_empty_strings

* test_tool_call_with_empty_enum_property

* test_fix_enum_empty_strings

* fix _fix_enum_empty_strings
2025-09-01 17:05:01 -07:00
Ishaan Jaff
7656cb3d6e test fix 2025-09-01 17:04:47 -07:00
Ishaan Jaff
2331fb45d5
[Bug]: Gemini 2.5 Pro – schema validation fails with OpenAI-style type arrays in tools (#14154)
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 16:53:20 -07:00
Byron Grogan
736bee813e fix: Support AWS_BEDROCK_RUNTIME_ENDPOINT on bedrock passthrough, make work for URLs with a base path 2025-09-01 17:47:26 -06:00
Ishaan Jaff
98d57b5d27
[Feat] Allow using x-litellm-stream-timeout header for stream timeout in requests (#14147)
* fix: allow passing stream_timeout header

* fix: _get_stream_timeout_from_request

* test_add_litellm_data_to_request_with_stream_timeout_header

* docs: LiteLLM Headers

* test_add_litellm_data_to_request_with_stream_timeout_header
2025-09-01 15:59:14 -07:00
Ishaan Jaff
58b713d19d
[Bug fix] Misclassified 500 error on invalid image_url in /chat/completions request (#14149)
* add ImageFetchError

* docs ImageFetchError

* fix ImageFetchError

* test_completion_with_invalid_image_url
2025-09-01 15:26:27 -07:00
Sameer Kankute
c51665ec9c
fix xai cost calculation (#14127) 2025-09-01 11:31:56 -07:00