Ishaan Jaff
1227b54fa6
test_get_model_info_gemini
2025-09-06 13:43:42 -07:00
Krrish Dholakia
7a083750ce
refactor: remove 'input_fidelity' from image gen -> it's a image_edit param
2025-09-06 12:14:27 -07:00
Krish Dholakia
447f1ea6bc
Merge pull request #14118 from iabhi4/fix-14100
...
bug(auth): support for ES256/ES384/ES512 and EdDSA JWT verification
2025-09-06 09:57:26 -07:00
Krish Dholakia
1980960218
Merge branch 'main' into litellm_responses_structured_output
2025-09-06 09:20:00 -07:00
Krish Dholakia
d1adc7896d
Merge pull request #14262 from TobiMayr/feature/gemini-reasoning-effort-minimal
...
feat: Add support for reasoning_effort='minimal' for Gemini models
2025-09-06 09:17:23 -07:00
Krish Dholakia
943f6a38ed
Merge pull request #14300 from eycjur/gpt-oss-reasoning-effort-mapping
...
Bug fix for openai.gpt-oss when using reasoning_effort parameter
2025-09-06 09:13:03 -07:00
katsuhiro muto
51de2ebb64
[Feat]Cancel upstream on client disconnect ( #14295 )
...
* cancel upstream on client disconnect
* add comments
* add test
* set timeout in constraints.py
* Guard against missing 'type' key
* update dependency to fix uvicorn bugs
2025-09-06 08:58:51 -07:00
eycjur
58cf72ef5e
add test
2025-09-06 21:12:18 +09:00
Ishaan Jaff
5310bba35b
[Feat] Litellm x CloudZero Integration - Cost Tracking ( #14296 )
...
* fix: just pull LiteLLM_DailyUserSpend
* get the team_id from user daily spend table
* cloudzero_dry_run_export
* fix CZ endpoints
* trace entity_id
* fix: get_usage_data
* fix get_usage_data
* fix _create_cbf_record
* fix get_usage_data
* ensure start and end time is used for exporting data
* fix init_cloudzero_background_job
* fix CloudZeroExportRequest
* fix initialize_cloudzero_export_job
* fix initialize_cloudzero_export_job
* allow init with env + config.yaml for cloudzero
* fix: init CZ through config.yaml
* fix DRY run on CZ
* TestCloudZeroDryRunEndpoint
* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES
* fix init_cloudzero_background_job
* fix exporting data
* fix transform
* stash cloudzero docs
* docs: CloudZero
* ruff fix
* fix rendering key alias
* fix polars
2025-09-05 21:29:41 -07:00
Sameer Kankute
07ba3ff036
[Feat] Add pass through image gen and image editing on OpenAI ( #14292 )
...
* add pass through image gen and image editing on OpenAI
* fix lint
2025-09-05 12:25:49 -07:00
Pierre-Emmanuel MERCIER
31f806f7d0
feat: add redis ssl and username support ( #11319 )
2025-09-05 10:35:11 -07:00
Ishaan Jaff
0a60390521
Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table ( #12922 )"
...
This reverts commit e3b752d3dc
2025-09-05 10:04:07 -07:00
Ishaan Jaff
982800069c
[Bug Fix] x-litellm-tags not routing with Responses API ( #14289 )
...
* fix: get_deployments_for_tag
* fix get_deployments_for_tag
* test_router_tag_routing.py
* test_get_metadata_variable_name_from_kwargs
* fix mapped tests
* docs fix
2025-09-05 09:40:37 -07:00
Sameer Kankute
231d54741f
Move test to test_litellm/ folder
2025-09-05 10:40:26 +05:30
Sameer Kankute
4fefac1bf2
Move test to test_litellm/ folder
2025-09-05 10:24:55 +05:30
Sameer Kankute
ad9f54a192
Move test to test_litellm/ folder
2025-09-05 10:08:34 +05:30
Sameer Kankute
f7f106f8b8
Move test to test_litellm/ folder
2025-09-05 10:00:58 +05:30
Krish Dholakia
f67339a86c
Merge pull request #14028 from onlylhf/volcengine-embedding-support
...
Add Volcengine embedding module with handler and transformation logic
2025-09-04 21:01:25 -07:00
Krish Dholakia
62d4623d1c
Merge pull request #14107 from uc4w6c/feat/add_guardrails_anthropic
...
feat: Add guardrail to the Anthropic API endpoint
2025-09-04 20:50:43 -07:00
Krish Dholakia
5d5c19a302
Merge pull request #14077 from TomeHirata/codex/add-support-for-anthropic-citation-api
...
Add support for anthropic citation api in Databricks
2025-09-04 20:46:11 -07:00
Ishaan Jaff
379b0dbf14
[Fix] Ensure team_id is a required field for generating service account keys ( #14270 )
...
* generate_service_account_key_fn
* fix validate_team_id_used_in_service_account_request
* fix types
* test_validate_team_id_used_in_service_account_request_requires_team_id
2025-09-04 18:14:38 -07:00
Ishaan Jaff
1352545617
[Fix] DD LLM Observability - Ensure apm_id is set on traces ( #14272 )
...
* add apm_id for DD LLM
* feat: add _get_apm_trace_id
2025-09-04 14:35:41 -07:00
tobias-mayr
29bbde5257
fix condition ordering and test
2025-09-04 22:18:50 +01:00
Krish Dholakia
94c1b21ae7
Merge branch 'main' into litellm_responses_structured_output
2025-09-04 12:23:26 -07:00
Krish Dholakia
796192dabe
Merge pull request #14130 from moshemorad/bedrock_fix_structure_output
...
Bedrock fix structure output
2025-09-04 12:22:35 -07:00
Krish Dholakia
e7b4892124
Merge pull request #14156 from byrongrogan/byron--bedrock-passthrough-override
...
fix: Support AWS_BEDROCK_RUNTIME_ENDPOINT on bedrock passthrough, make work for URLs with a base path
2025-09-04 12:20:17 -07:00
Sameer Kankute
fc9560573b
[BUG] Fix response api for reasoning item in input for litellm proxy ( #14200 )
...
* fix response api for litellm proxy
* Add test for checking if status is getting removed
* add test in correct file
* remove hardcoded fields
* Make the handling simpler
* fix lint error:
2025-09-04 10:36:48 -07:00
Sameer Kankute
8d67392e99
Merge branch 'main' into litellm_responses_structured_output
2025-09-04 22:35:30 +05:30
Sameer Kankute
5f79e8aac6
Litellm passthrough cost tracking chat completion ( #14256 )
...
* feat: add structured output for sdk
* Add support for cost tracking for chat completion in passthrough
* remove not required changes
2025-09-04 09:57:48 -07:00
Ishaan Jaff
1237be04a5
test_aaamodel_prices_and_context_window_json_is_valid
2025-09-04 07:58:20 -07:00
Krish Dholakia
a8cce5fbf3
Merge pull request #14237 from yeahyung/fix/tpm_limit_bug
...
Fixes #14204 TPM Rate Limit Bug
2025-09-04 07:29:47 -07:00
22mSqRi
25afa67616
fix: Key Budget not resets at expectable times
2025-09-04 09:04:01 +00:00
yeahyung
7829de2948
( #14204 ) add test code
2025-09-04 16:41:29 +09:00
Ishaan Jaff
23ae7170d1
[Feat] Allow using Veo Video Generation through LiteLLM Pass through routes ( #14228 )
...
* fix: add follow_redirects=True,
* test_pass_through_with_httpbin_redirect
* cook book veo video
* docs Veo Video Generation with Google AI Studio
* add veo-3.0-generate-preview cost tracking details
* track vertex_video_models
2025-09-03 18:25:43 -07:00
Ishaan Jaff
be7c762882
add video_generation
2025-09-03 18:25:27 -07:00
Ishaan Jaff
19e2bab8c8
[Feat] Add Initial support for Bedrock Batches API ( #14190 )
...
* fix acreate_file with bedrock
* fix routing to bedrock batches api
* fix create_file
* working batch file upload
* fix batches API for file upload
* test: bedrock files and batches API
* add BaseBatchesConfig
* fix get_provider_batches_config
* transform bedrock batches
* fix run create batch through llm http handler
* test_async_file_and_batch
* main.batches creation
* fix: CommonBatchFilesUtils
* fix async_create_batch
* test_async_file_and_batch
* BedrockBatchesConfig
* fix ruff check
* ruff check fix
* fix docs ref
2025-09-03 17:19:58 -07:00
Ishaan Jaff
beb300abae
[Fix] SCIM - Bug fixes for handling SCIM Group Memberships ( #14226 )
...
* Feat: add better SCIM debugging
* fix _get_scim_member_display
* fix patch_group
* test_update_group_e2e
* test_get_scim_member_value
2025-09-03 16:15:51 -07:00
Ishaan Jaff
8e9352fce7
test fix
2025-09-03 11:06:09 -07:00
katsuhiro muto
ca43514db4
[Feat] Support reasoning_effort in Groq ( #14207 )
...
* Support reasoning_effort in groq
* add test
2025-09-03 10:43:47 -07:00
Sameer Kankute
8e363fe78c
feat: add structured output for sdk
2025-09-03 17:58:55 +05:30
TomuHirata
bb5127b8a0
Merge branch 'BerriAI:main' into citation-supported-text-3
2025-09-02 20:46:48 -10:00
Ishaan Jaff
63c4a30564
TestVertexAIGPTOSSTransformation
2025-09-02 23:07:52 -07:00
Krish Dholakia
35b501b8d5
Merge pull request #14176 from mjmendo/feat/alert_type_in_slack_message
...
feat: added alert type to alert messate to slack for easier handling
2025-09-02 23:05:41 -07:00
Krish Dholakia
dc0d2a44a5
Merge pull request #14171 from kutsushitaneko/fix/14158_tool_call_id
...
fix(oci): Handle assistant messages with both content and tool_calls in OCI provider (#14158 )
2025-09-02 23:05:04 -07:00
Krish Dholakia
c8b177963e
Merge pull request #14191 from kayoch1n/fix-h11-model-name
...
Remove "/" or ":" from model name when being used as h11 header name
2025-09-02 23:02:45 -07:00
kayoch1n
76555cad81
Format code
2025-09-03 11:20:52 +08:00
kayoch1n
ffbe5cd899
Add a testcase
2025-09-03 11:08:23 +08:00
Krish Dholakia
46655544a4
Merge pull request #14179 from zhirafovod/otel_logs_metrics
2025-09-02 19:50:40 -07:00
Ishaan Jaff
128d9a3488
[Feature]: Add header support for spend_logs_metadata ( #14186 )
...
* fix: allow settings spend_logs_metadata
* fix add_litellm_data_for_backend_llm_call
* fix: add add_litellm_metadata_from_request_headers
* fix add_litellm_metadata_from_request_headers
* test_add_litellm_metadata_from_request_headers
* add_litellm_metadata_from_request_headers
* docs Tracking Spend with custom metadata
* add_litellm_metadata_from_request_headers
* add_litellm_metadata_from_request_headers
2025-09-02 15:13:15 -07:00
Ishaan Jaff
c821f1ddf1
[Feature]: Support GPT-OSS models on vertex ai ( #14184 )
...
* add VertexAIGPTOSSTransformation
* fix: optional_params
* fix: is_vertex_partner_model
* test_partner_models_httpx
* docs GPT oss docs
* test_vertex_ai_gpt_oss_reasoning_effort
* add vertex ai models
2025-09-02 14:15:26 -07:00
