Krrish Dholakia
13badfa9ae
test: update testing
2025-05-31 00:45:19 -07:00
Krrish Dholakia
7e389fb4b2
fix: fix linting error
2025-05-31 00:14:43 -07:00
Krrish Dholakia
808d7cc31c
fix(parallel_request_limiter_v2.py): update tpm tracking to use slot key logic
2025-05-31 00:13:35 -07:00
Krrish Dholakia
732dffa6b1
fix(base_routing_strategy.py): catch the delta change during redis sync
...
ensures values are kept in sync
2025-05-30 23:50:15 -07:00
Krrish Dholakia
4a9908eaba
fix(base_routing_strategy.py): fix merge from redis - preserve values in in-memory cache during gap b/w push to redis and read from redis
2025-05-30 18:15:48 -07:00
Krrish Dholakia
0f363f7b48
fix(parallel_request_limiter_v2.py): decrement usage on rate limit error
2025-05-30 17:23:36 -07:00
Krrish Dholakia
f757489033
feat(parallel_request_limiter_v2.py): add sliding window logic
...
allows rate limiting to work across minutes
2025-05-30 16:26:04 -07:00
Ishaan Jaff
c9062ac044
fixes: test_create_user_default_budget
2025-05-29 21:12:28 -07:00
Ishaan Jaff
afb75dc50c
bump: bump litellm enterprise
2025-05-29 20:41:03 -07:00
Ishaan Jaff
7fcbb38d91
[Fix] Responses API - Session management ( #11254 )
...
* fix: import session handling
* fix: imports for session handler
* tests: tests for session handler
* Update enterprise/litellm_enterprise/enterprise_callbacks/session_handler.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-29 20:36:02 -07:00
Ishaan Jaff
f24d8919c4
[Feat]: Guardrails - Add streaming for bedrock post guard ( #11247 )
...
* feat: add streaming for bedrock post guard
* fix: bedrock guardrails
* fix: add clear comments
* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* fix: clean up bedrock guardrails
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-29 20:01:44 -07:00
Ishaan Jaff
62a083de02
fix: linting pin mypy
2025-05-29 19:58:31 -07:00
Ishaan Jaff
0d4c85c419
Revert "fix: import session handling"
...
This reverts commit deb257dc10
2025-05-29 17:54:24 -07:00
Ishaan Jaff
deb257dc10
fix: import session handling
2025-05-29 17:48:34 -07:00
Ishaan Jaff
5e6f6ddc52
[Feat]: Add Bedrock InvokeAgents as a /chat/completions route on LiteLLM ( #11239 )
...
* feat: init structure for bedrock AGENTs
* feat: add basic routing for bedrock AGENTs
* feat: add basic transforms for bedrock AGENTs
* fix: url for bedrock agent runtime
* fix: working agents request
* feat: working agents non-streaming request
* feat: bedrock agents
* feat: add streaming for bedrock agents
* feat: add cost tracking for bedrock agents
* docs litellm with bedrock agents
* fix: linting errors
* test: invoke agents tests
2025-05-29 16:48:55 -07:00
Fadil Rahman
dd8d23be62
Removed syntax error from docs ( #11242 )
2025-05-29 15:34:16 -07:00
Krrish Dholakia
368e59181d
docs(entity_usage.tsx): fix bad link
2025-05-29 11:00:18 -07:00
AnilAren
9a82a69593
fix: bedrock ai21 jamba models will work now ( #11233 )
2025-05-29 08:31:05 -07:00
VigneshwarRajasekaran
974c928672
changed model name is request and updating to latest response format in proxy quick start guide as 3.5 turbo is retired and leads to error when a call is made using liteLLM to respective Azure-openAI endpoints. ( #11223 )
2025-05-29 08:27:56 -07:00
Emmanuel Ferdman
7dcfde2a1c
fix the litellm CLA reference ( #11230 )
...
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
2025-05-29 08:27:14 -07:00
Krrish Dholakia
dececb84c1
docs(image_edits.md): clarify proxy version support for image edits
2025-05-29 07:50:41 -07:00
Krrish Dholakia
077b69eafa
fix(key_management_endpoints.py): allow master key rotations for OSS users
...
Closes https://github.com/BerriAI/litellm/issues/11210
2025-05-28 22:56:25 -07:00
Krish Dholakia
8fb2779c9e
build(model_prices_and_context_window.json): add supports parallel function calling to all gemini models ( #11225 )
2025-05-28 22:32:02 -07:00
Krish Dholakia
1995c7aad5
fix(utils.py): support non default params for audio transcription ( #11212 )
...
* fix(utils.py): support non default params for audio transcription
allows passing provider specific params straight through on transcription calls
* fix(gpt_transformation.py): fix o_series model routing
call _transform_request on async event
* refactor: refactor tests
* test(test_azure_chat_o_series_transformation.py): add unit test for azure o series error
* test: update test
* test: update json
* fix: fix mutiple keyword error
2025-05-28 22:24:02 -07:00
Krish Dholakia
ba39f9e360
Helicone base url support + fix for embedding cache hits on str input ( #11211 )
...
* fix(helicone.py): add helicone api base support
Fixes https://github.com/BerriAI/litellm/issues/10825
* test: add unit test for cache hit response on embedding calls
* fix(caching_handler.py): fix handling cache hit on embedding when input is string
Fixes LIT-197
* docs(helicone_integration.md): document new helicone api base param
2025-05-28 22:02:55 -07:00
Krrish Dholakia
75f591a6e2
docs(cli.md): add new skip_server_startup flag
2025-05-28 21:47:08 -07:00
Ishaan Jaff
2e5f635803
bump: version 1.71.2 → 1.71.3
2025-05-28 21:39:14 -07:00
Ishaan Jaff
2372492237
test: fix test_user_email_metrics
2025-05-28 21:30:47 -07:00
Ishaan Jaff
226c3b74ba
build: fix ui build
2025-05-28 21:26:18 -07:00
Ishaan Jaff
711c931c71
test: fix test_key_generation_with_object_permission
2025-05-28 21:24:35 -07:00
Ishaan Jaff
c5a82b03f4
Revert "(build) fix ui build"
...
This reverts commit 73a82d24d8
2025-05-28 21:21:10 -07:00
Ishaan Jaff
7ac05087c3
Revert "build(deps): bump next from 14.2.26 to 15.2.4 in /ui/litellm-dashboard ( #11216 )"
...
This reverts commit 461e1a4751
2025-05-28 21:20:56 -07:00
Ishaan Jaff
f0618fd297
Revert "(ui) fix build"
...
This reverts commit 90dbf4cf0b
2025-05-28 21:20:35 -07:00
Ishaan Jaff
90dbf4cf0b
(ui) fix build
2025-05-28 21:18:09 -07:00
Ishaan Jaff
edf85f2394
fix: code QA check
2025-05-28 21:16:17 -07:00
Ishaan Jaff
73a82d24d8
(build) fix ui build
2025-05-28 21:05:33 -07:00
Ishaan Jaff
745d9acdc3
fix: code QA check
2025-05-28 21:03:33 -07:00
Ishaan Jaff
6b527a77aa
ci/cd fix build ui
2025-05-28 21:00:39 -07:00
Ishaan Jaff
68a2466f3d
fix debug langfuse clients started ( #11221 )
2025-05-28 19:16:52 -07:00
Ishaan Jaff
9e75409518
bump litellm proxy extras
2025-05-28 18:58:33 -07:00
Ishaan Jaff
5a32fb89b0
build: add vector stores to object permissions
2025-05-28 18:55:05 -07:00
Ishaan Jaff
df76b8c7b9
ui new build
2025-05-28 18:53:37 -07:00
Ishaan Jaff
b35806d0f0
ui new build
2025-05-28 18:53:01 -07:00
Ishaan Jaff
096e03bbc6
scim fix - key ( #11220 )
2025-05-28 18:47:51 -07:00
Stephen Solka
3960e08dd7
Fix: Remove duplicate object_permission field in LiteLLM_TeamTable ( #11219 )
...
This fixes a mypy error where 'object_permission' was already defined on line 1267.
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-authored-by: Stephen Solka <stephen@standd.io>
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-28 18:40:45 -07:00
Ishaan Jaff
4e6c4beef8
[Feat] Permission management vector stores on LiteLLM Key, Team, Orgs ( #11213 )
...
* fix: init commit for object permissions
* fix: init commit for object permissions
* fix: add vector_store_id to permissions
* fix vector store selector
* feat:add vector store permission mgmt
* feat: ui add allowed vector stores dropdown
* feat: add new vector store object permissions
* testing: key mgmt
* fix: stor vector store permissions on team
* ui select vector store for teams
* ui add vector store settings for orgs
* feat: allow setting org vector store permissions
* test: adding team permissions for vector stores
2025-05-28 16:58:53 -07:00
Vinnie-Singleton-NN
178a614d4a
Add sentry sample rate ( #10283 )
...
* Add SENTRY_API_SAMPLE_RATE configuration option for Sentry SDK
* removed print line
* Update Sentry documentation with sample rate information
---------
Co-authored-by: Vinnie <vinnie@Vinnies-MacBook-Pro.local>
2025-05-28 16:44:10 -07:00
Regis David Souza Mesquita
56c32ef503
Update mistral-medium prices and context sizes ( #10729 )
...
* Update mistral-medium prices and context sizes
While testing the Mistral model, I noticed a discrepancy in the pricing shown on the logs screen. After reviewing the code, I confirmed that the pricing values were incorrect.
This PR corrects the input and output token pricing for the latest Mistral model and adds the newly released mistral-medium-2505 version.
* Adds tool calling flag to mistral-medium
* Adds mistral-medium price updates to the main model price file
* Update model_prices_and_context_window_backup.json
sets mistral medium alias to the old values as it probably points to the old version.
* Update model_prices_and_context_window.json
* Update model_prices_and_context_window_backup.json
* Update model_prices_and_context_window.json
2025-05-28 16:42:28 -07:00
tanjiro
14cdf61537
Improve display of model tags on Keys, Teams and Org page ( #11022 )
...
* added accordian for models tag
* remove margin top
* match badge styles same as on teams page
* add badge accordian for organizations
* badges fixed on keys page
* fixed for singular and plural
* fix merge conflict
2025-05-28 16:41:26 -07:00
dependabot[bot]
461e1a4751
build(deps): bump next from 14.2.26 to 15.2.4 in /ui/litellm-dashboard ( #11216 )
...
Bumps [next](https://github.com/vercel/next.js ) from 14.2.26 to 15.2.4.
- [Release notes](https://github.com/vercel/next.js/releases )
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js )
- [Commits](https://github.com/vercel/next.js/compare/v14.2.26...v15.2.4 )
---
updated-dependencies:
- dependency-name: next
dependency-version: 15.2.4
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-28 16:39:20 -07:00
