Commit graph

13345 commits

Author SHA1 Message Date
Ishaan Jaff
628cd13755
[Feat] UI - Allow scheduling key rotations when creating virtual keys (#14960)
* fix design of key reset interval

* fix: LiteLLM_VerificationToken

* fix key manager

* add key_rotation_at

* ui fix

* fix ui view

* set key_rotation_at  on creation

* add key_rotation_at

* fix info

* fix: _set_key_rotation_fields

* fix KeyRotationManager

* fix key edit view

* test_update_key_fn_auto_rotate_enable

* fix KeyRotationManager
2025-09-26 16:24:40 -07:00
Maximgitman
f2d7c1c14d Fix Anthropic streaming IDs 2025-09-26 18:31:10 -04:00
Sameerlite
ce0b815959 fix test 2025-09-27 02:08:09 +05:30
Sameer Kankute
94edbd1b35
Merge pull request #14957 from BerriAI/main
merge main
2025-09-27 01:54:44 +05:30
Sameerlite
61a450f2e2 fix lint 2025-09-27 01:16:09 +05:30
Sameerlite
67e7ad5aa9 Add vertex live api passthrough with cost tracking 2025-09-27 00:55:47 +05:30
Ishaan Jaff
ea8d0bb7d5 fix: re-add scheduled rotations 2025-09-26 11:40:46 -07:00
Ishaan Jaffer
539d10f9cb test fix 2025-09-26 11:06:26 -07:00
Ishaan Jaff
d04c6d4eea
[Feat] Add new anthropic web fetch tool support (#14951)
* add web_fetch tool for ANTHROPIC_HOSTED_TOOLS

* add ANTHROPIC_BETA_HEADER_VALUES, ANTHROPIC_HOSTED_TOOLS

* feat: add web fetch tool anthropic

* test_anthropic_tool_use

* docs web fetch

* docs fix

* docs fix
2025-09-26 11:04:11 -07:00
Alex Shoop
914844122c
Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941)
* always use fastuuid

* rm from proxy extras since its now default

* poetry lock
2025-09-26 09:14:20 -07:00
Krish Dholakia
79ebb2c95e
Merge pull request #14888 from mrFranklin/feat/improve-opik
feat: improve opik integration code
2025-09-25 23:40:41 -07:00
Krish Dholakia
f2f75bf911
Merge pull request #14893 from vertexcover-io/fix/openai-image-edit-support-images
🐛 Fix a bug where openai image edit siltently ignores multiple images
2025-09-25 23:37:52 -07:00
Ritesh Kadmawala
af0cb7c277 🐛 Fix a bug where openai image edit siltently ignores multiple images 2025-09-26 10:56:06 +05:30
Mubashir Osmani
625ed3f8cf
fix: prisma client state retries (#14925)
* added qwen models and gpt-5-codex

* fix flaky test

* fix failing test

* Added retries to prisma client state

* fix: prisma client state retries in pods

* Revert "fix failing test"

This reverts commit dbec4988a2.

* Revert "fix flaky test"

This reverts commit b0ac2f2dc3.

* Revert "added qwen models and gpt-5-codex"

This reverts commit 9a8a8f2d47.

* Revert "fix: prisma client state retries in pods"

This reverts commit 04e58e5ca1.

* fix lint

* Revert "fix lint"

This reverts commit 5303d52a5e.

* fixed lint
2025-09-25 21:54:00 -07:00
Sameer Kankute
1681bf7175
(Feat) Add BitBucket Integration for Prompt Management (#14882)
* Add bitbucket integration for prompt management

* remove not needed file

* remove not needed file

* Add the correct readme

* Add the correct readme

* fix test for bitbucket

* fix test for bitbucket
2025-09-25 15:51:00 -07:00
Ishaan Jaff
2dd38420a7
[Feat] - Cost Tracking - show input, output, tool call cost breakdown in StandardLoggingPayload (#14921)
* add new CostBreakdown typed dict

* fix CostBreakdown type

* fix fix _store_cost_breakdown_in_logging_obj

* fix CostBreakdown

* test_cost_breakdown_in_standard_logging_payload
2025-09-25 15:48:22 -07:00
Alexsander Hamir
eaa04cd8ce
fix: use fastuuid helper (#14903)
* fix: use fastuuid helper across the codebase

First batch of changes, simple drop in replacement.

* second batch of changes

* fixed: script mistake on helper file
2025-09-25 15:47:01 -07:00
Ishaan Jaff
ab5fb704c2
[Feat] Logging - datadog callback Log message content w/o sending to datadog (#14909)
* add DatadogInitParams

* fix _get_datadog_params

* test_datadog_message_redaction
2025-09-25 15:46:22 -07:00
Arshdeep Singh
471f011ae5 fix: add return type annotation for full mypy compliance 2025-09-25 12:52:12 -04:00
Arshdeep Singh
8193f56876 fix: remove print statement to pass ruff linting checks 2025-09-25 12:39:49 -04:00
Arshdeep Singh
39683cc3d8 fix: remove unused custom_recognizers variable to pass linting 2025-09-25 12:31:08 -04:00
Arshdeep Singh
8364da014f style: format code with black 2025-09-25 12:23:44 -04:00
Arshdeep Singh
82ec42993f fix(presidio): enable custom PII entities with Union type 2025-09-25 12:16:22 -04:00
mrFranklin
f221ce5866 chore: add a comment explaining why update one second to three second 2025-09-25 14:28:49 +08:00
mrFranklin
02a41d76be fix: add default value to pass the opik test 2025-09-25 14:23:00 +08:00
Ishaan Jaffer
b1e56c55ad merge 2025-09-24 22:11:37 -07:00
Ishaan Jaff
ded823a3a3
[Feat] Initial support for scheduled key rotations (#14877)
* add KeyRotationSettings

* add KeyRotationManager

* add key rotation manager

* add KeyRotationManager

* fix _initialize_spend_tracking_background_jobs

* fix add_key_rotation_fields

* fixes

* new fields in schema

* update schema

* fix fixes for init key rotation manager

* fixes for init key rotation manager

* fix KeyRotationManager

* tests for key rotation

* fix key_rotation_settings

* fix KeyRotationManager

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix fixes for init key rotation manager

* ruff check fix

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix _initialize_spend_tracking_background_jobs

* docs fix

* docs auto rotate

* schema fix

* bump proxy extras

* fix config.yml
2025-09-24 21:37:56 -07:00
Ishaan Jaffer
ba1cd3f0d2 Revert "feature: generic object pool (#14702)"
This reverts commit 60800698f2.
2025-09-24 21:36:49 -07:00
Ishaan Jaff
d9bf6a8c53
Revert "Fix: make pondpond as optional dependency for proxy extras, disab…" (#14880)
This reverts commit e75d8b711e.
2025-09-24 21:34:42 -07:00
Alex Shoop
e75d8b711e
Fix: make pondpond as optional dependency for proxy extras, disable object pooling gracefully (#14863)
* pondpond optional dep proxy extra

* lock
2025-09-24 17:09:30 -07:00
Krrish Dholakia
df88b0656e test: update .json 2025-09-24 16:13:51 -07:00
Copilot
1816176f9d
[Memory Leak Fix] Fix InMemoryCache unbounded growth when TTLs are set (#14869)
* Initial plan

* Fix InMemoryCache unbounded growth issue when TTLs are set

Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-09-24 11:54:06 -07:00
Ishaan Jaff
c69bac991b
[Fix] LakeraAI v2 Guardrail - Ensure exception is raised correctly (#14867)
* fix exception lakera

* test lakera ai v2

* ruff fix
2025-09-24 10:55:56 -07:00
Mubashir Osmani
0cd91a82d2
Added vertex_ai/qwen models and azure/gpt-5-codex (#14844)
* added qwen models and gpt-5-codex

* fix flaky test

* fix failing test
2025-09-24 10:40:00 -07:00
Fabrício Ceschin
5eb32e0c24
Merge branch 'BerriAI:main' into LangfuseUsageDetails 2025-09-24 09:43:43 -04:00
Krish Dholakia
37ea89eff0
Merge pull request #14821 from hazyone/fix-13380
Fix: support claude code auth via subscription (anthropic)
2025-09-23 22:52:32 -07:00
Krish Dholakia
aede742db5
Merge pull request #14818 from akshoop/akshoop/fastuuid-dep-make-optional
Fix: make `fastuuid` an optional dependency for `proxy`, graceful fallback to stdlib `uuid`
2025-09-23 22:51:10 -07:00
Krish Dholakia
d59dec39d0
Merge pull request #14826 from Jetemple/sso-clear-button-fix
fix: SSO "Clear" button writes empty values instead of removing SSO config
2025-09-23 22:49:47 -07:00
Sameer Kankute
e132ad63f1
Merge pull request #14164 from TomeHirata/citation-supported-text-3
Add supported text field to anthropic citation response
2025-09-24 10:30:44 +05:30
Ishaan Jaff
f4ecf3ca72
[Feat] Fixes for LiteLLM Proxy CLI to Auth to Gateway (#14836)
* fix: error msg from updating key

* fix _create_new_cli_key

* fix validate_key_team_change

* fix interface for chat

* ruff fix

* fix auth for keys

* get_litellm_gateway_api_key

* fix chat

* test fix

* linting fix

* fix mypy

* test_validate_key_team_change_with_member_permissions
2025-09-23 19:43:32 -07:00
Ishaan Jaffer
e1b342604d test vertex test_get_token_url 2025-09-23 19:34:50 -07:00
Alex Shoop
c919996470
Merge branch 'main' into akshoop/fastuuid-dep-make-optional 2025-09-24 10:31:09 +09:00
Ishaan Jaffer
6964b5a67a test humanloop 2025-09-23 18:28:27 -07:00
Alex Shoop
b6247d0d77 code cov test script check_fastuuid_usage.py 2025-09-24 10:27:22 +09:00
Krish Dholakia
64a305f9dd
Merge pull request #14721 from dharamendrak/reuse-aiohttp-session-http-handler
feat: Add shared_session parameter for aiohttp ClientSession reuse
2025-09-23 18:07:32 -07:00
Ishaan Jaffer
a48273740d test fix 2025-09-23 17:46:09 -07:00
Ishaan Jaffer
ceb400eee9 Revert "Added model armor testing files basic"
This reverts commit 9d1878029d.
2025-09-23 17:45:44 -07:00
Ishaan Jaffer
79a6feb7ac generate_mock_mcp_server_config_record 2025-09-23 17:33:11 -07:00
Ishaan Jaffer
eb72990aa6 test_get_valid_models_with_cli_pattern 2025-09-23 16:46:40 -07:00
Ishaan Jaffer
aaebd83f31 test fixes 2025-09-23 16:07:01 -07:00