Commit graph

3015 commits

Author SHA1 Message Date
Krish Dholakia
9a62b9bdb9
Merge pull request #14161 from BerriAI/litellm_dev_09_01_2025_p2
Security fix - prevent proxy_admin_viewer from modifying other user's credentials + remove hardcoded sensitive keys from test repo
2025-09-06 22:14:45 -07:00
Krish Dholakia
e31b2d9eba
Merge pull request #9902 from btemplep/main
fix bedrock embedding invocations with app inference profiles
2025-09-06 22:13:35 -07:00
Krish Dholakia
fbc0ec98b6
Merge pull request #12438 from jasonpnnl/fix-customer-update
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
2025-09-06 22:12:30 -07:00
Krish Dholakia
ba10173ec7
Merge branch 'main' into heroku-llms 2025-09-06 22:10:20 -07:00
Krish Dholakia
884cca7da9
Merge pull request #12984 from darashenka/main
honor OLLAMA_API_KEY for ollama_chat
2025-09-06 22:07:28 -07:00
Krrish Dholakia
06d472f205 test: fix tests 2025-09-06 21:59:02 -07:00
Krish Dholakia
db6fd68540
Merge pull request #14160 from BerriAI/litellm_dev_09_01_2025_p1
MINOR update: Add openrouter image generation support + refactor Gemini `image` output param to be `images` (openrouter compatible)
2025-09-06 19:26:00 -07:00
Ishaan Jaff
c9ab104445
[Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes (#14305)
* Implement pass-through route registration and removal to prevent duplicates and memory leaks

* fix MYPY linting

* fix InitPassThroughEndpointHelpers

* fix test_aaparallel_function_call

---------

Co-authored-by: Jugal Bhatt <jugalbhatt3@gmail.com>
2025-09-06 19:22:25 -07:00
Krish Dholakia
2716fa7981
Merge branch 'main' into litellm_dev_09_01_2025_p2 2025-09-06 19:03:25 -07:00
Krrish Dholakia
5a0328b1a9 test: update tests 2025-09-06 19:02:03 -07:00
Krish Dholakia
a3ffc3060e
Merge branch 'main' into litellm_dev_09_01_2025_p1 2025-09-06 18:50:49 -07:00
Ishaan Jaff
0f26ec57d8 TestGroq 2025-09-06 18:19:09 -07:00
Ishaan Jaff
3b0aec2e5d test_azure_openai_gpt_5_responses_api 2025-09-06 17:47:01 -07:00
Ishaan Jaff
679d0414e2 test fix 2025-09-06 17:08:31 -07:00
Ishaan Jaff
d89a2a0797 test 2025-09-06 16:38:43 -07:00
Ishaan Jaff
c168fff38a test_cooldown_badrequest_error 2025-09-06 16:28:00 -07:00
Ishaan Jaff
2982c2a932 fix test_key_budget_metrics 2025-09-06 16:18:50 -07:00
Ishaan Jaff
7054067238 test_cooldown_handlers.py 2025-09-06 16:13:30 -07:00
Ishaan Jaff
c709d7505d test fix: test_parallel_streaming_requests 2025-09-06 16:07:30 -07:00
Ishaan Jaff
49532d6d8b
Revert "[Feat]Cancel upstream on client disconnect (#14295)" (#14304)
This reverts commit 51de2ebb64.
2025-09-06 15:29:15 -07:00
Ishaan Jaff
7f5460465c unit test oai pass through 2025-09-06 14:54:34 -07:00
Ishaan Jaff
b1552cae46 fix mocked CZ tests 2025-09-06 14:33:02 -07:00
Ishaan Jaff
8920a645e9
Revert "feat: add redis ssl and username support (#11319)" (#14303)
This reverts commit 31f806f7d0.
2025-09-06 14:01:00 -07:00
Ishaan Jaff
fc7accad74 test_dry_run_export_usage_data_cbf_transformation_failure 2025-09-06 13:59:28 -07:00
Ishaan Jaff
1227b54fa6 test_get_model_info_gemini 2025-09-06 13:43:42 -07:00
Krrish Dholakia
7a083750ce refactor: remove 'input_fidelity' from image gen -> it's a image_edit param 2025-09-06 12:14:27 -07:00
Krish Dholakia
447f1ea6bc
Merge pull request #14118 from iabhi4/fix-14100
bug(auth): support for ES256/ES384/ES512 and EdDSA JWT verification
2025-09-06 09:57:26 -07:00
Krish Dholakia
1980960218
Merge branch 'main' into litellm_responses_structured_output 2025-09-06 09:20:00 -07:00
Krish Dholakia
d1adc7896d
Merge pull request #14262 from TobiMayr/feature/gemini-reasoning-effort-minimal
feat: Add support for reasoning_effort='minimal' for Gemini models
2025-09-06 09:17:23 -07:00
Krish Dholakia
943f6a38ed
Merge pull request #14300 from eycjur/gpt-oss-reasoning-effort-mapping
Bug fix for openai.gpt-oss when using reasoning_effort parameter
2025-09-06 09:13:03 -07:00
katsuhiro muto
51de2ebb64
[Feat]Cancel upstream on client disconnect (#14295)
* cancel upstream on client disconnect

* add comments

* add test

* set timeout in constraints.py

* Guard against missing 'type' key

* update dependency to fix uvicorn bugs
2025-09-06 08:58:51 -07:00
eycjur
58cf72ef5e add test 2025-09-06 21:12:18 +09:00
Ishaan Jaff
5310bba35b
[Feat] Litellm x CloudZero Integration - Cost Tracking (#14296)
* fix: just pull LiteLLM_DailyUserSpend

* get the team_id from user daily spend table

* cloudzero_dry_run_export

* fix CZ endpoints

* trace entity_id

* fix: get_usage_data

* fix get_usage_data

* fix _create_cbf_record

* fix get_usage_data

* ensure start and end time is used for exporting data

* fix init_cloudzero_background_job

* fix CloudZeroExportRequest

* fix initialize_cloudzero_export_job

* fix initialize_cloudzero_export_job

* allow init with env + config.yaml for cloudzero

* fix: init CZ through config.yaml

* fix DRY run on CZ

* TestCloudZeroDryRunEndpoint

* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES

* fix init_cloudzero_background_job

* fix exporting data

* fix transform

* stash cloudzero docs

* docs: CloudZero

* ruff fix

* fix rendering key alias

* fix polars
2025-09-05 21:29:41 -07:00
Sameer Kankute
07ba3ff036
[Feat] Add pass through image gen and image editing on OpenAI (#14292)
* add pass through image gen and image editing on OpenAI

* fix lint
2025-09-05 12:25:49 -07:00
Pierre-Emmanuel MERCIER
31f806f7d0
feat: add redis ssl and username support (#11319) 2025-09-05 10:35:11 -07:00
Ishaan Jaff
0a60390521 Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table (#12922)"
This reverts commit e3b752d3dc.
2025-09-05 10:04:07 -07:00
Ishaan Jaff
982800069c
[Bug Fix] x-litellm-tags not routing with Responses API (#14289)
* fix: get_deployments_for_tag

* fix get_deployments_for_tag

* test_router_tag_routing.py

* test_get_metadata_variable_name_from_kwargs

* fix mapped tests

* docs fix
2025-09-05 09:40:37 -07:00
Sameer Kankute
231d54741f Move test to test_litellm/ folder 2025-09-05 10:40:26 +05:30
Sameer Kankute
4fefac1bf2 Move test to test_litellm/ folder 2025-09-05 10:24:55 +05:30
Sameer Kankute
ad9f54a192 Move test to test_litellm/ folder 2025-09-05 10:08:34 +05:30
Sameer Kankute
f7f106f8b8 Move test to test_litellm/ folder 2025-09-05 10:00:58 +05:30
Krish Dholakia
f67339a86c
Merge pull request #14028 from onlylhf/volcengine-embedding-support
Add Volcengine embedding module with handler and transformation logic
2025-09-04 21:01:25 -07:00
Krish Dholakia
62d4623d1c
Merge pull request #14107 from uc4w6c/feat/add_guardrails_anthropic
feat: Add guardrail to the Anthropic API endpoint
2025-09-04 20:50:43 -07:00
Krish Dholakia
5d5c19a302
Merge pull request #14077 from TomeHirata/codex/add-support-for-anthropic-citation-api
Add support for anthropic citation api in Databricks
2025-09-04 20:46:11 -07:00
Ishaan Jaff
379b0dbf14
[Fix] Ensure team_id is a required field for generating service account keys (#14270)
* generate_service_account_key_fn

* fix validate_team_id_used_in_service_account_request

* fix types

* test_validate_team_id_used_in_service_account_request_requires_team_id
2025-09-04 18:14:38 -07:00
Ishaan Jaff
1352545617
[Fix] DD LLM Observability - Ensure apm_id is set on traces (#14272)
* add apm_id for DD LLM

* feat: add _get_apm_trace_id
2025-09-04 14:35:41 -07:00
tobias-mayr
29bbde5257 fix condition ordering and test 2025-09-04 22:18:50 +01:00
Krish Dholakia
94c1b21ae7
Merge branch 'main' into litellm_responses_structured_output 2025-09-04 12:23:26 -07:00
Krish Dholakia
796192dabe
Merge pull request #14130 from moshemorad/bedrock_fix_structure_output
Bedrock fix structure output
2025-09-04 12:22:35 -07:00
Krish Dholakia
e7b4892124
Merge pull request #14156 from byrongrogan/byron--bedrock-passthrough-override
fix: Support AWS_BEDROCK_RUNTIME_ENDPOINT on bedrock passthrough, make work for URLs with a base path
2025-09-04 12:20:17 -07:00