scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-14 23:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 102
22306 commits 2357 branches 1407 tags 2.7 GiB
Commit graph

22306 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ishaan Jaff
f95754c67f (UI) new build 2025-05-31 12:25:29 -07:00
Ishaan Jaff
ebf05c10a9 (ui) fix view 2025-05-31 12:21:40 -07:00
Ishaan Jaff
0dca4780c5 ui - fix permission checks 2025-05-31 12:19:37 -07:00
Ishaan Jaff
b0f2d969e7 (ui) fix passing premium user 2025-05-31 12:15:56 -07:00
Ishaan Jaff
7b4fb48bd1 ui new build 2025-05-31 12:08:48 -07:00
Ishaan Jaff
3be42fd744 ui fixes 2025-05-31 12:08:09 -07:00
Ishaan Jaff
75f87724bd chore - vector store permissions enterprise 2025-05-31 12:01:51 -07:00
Ishaan Jaff
372de1476b (chore): mark object permissions as enterprise 2025-05-31 11:52:59 -07:00
Krish Dholakia
39849627f7
feat(parallel_request_limiter_v2.py): add sliding window logic (#11283) 
* feat(parallel_request_limiter_v2.py): add sliding window logic

allows rate limiting to work across minutes

* fix(parallel_request_limiter_v2.py): decrement usage on rate limit error

* fix(base_routing_strategy.py): fix merge from redis - preserve values in in-memory cache during gap b/w push to redis and read from redis

* fix(base_routing_strategy.py): catch the delta change during redis sync

ensures values are kept in sync

* fix(parallel_request_limiter_v2.py): update tpm tracking to use slot key logic

* fix: fix linting error

* test: update testing

* test: update tests

* test: skip on rate limit or internal server errors

* test: use pytest fixture instead

* test: bump mistral model
 2025-05-31 10:06:42 -07:00
Ishaan Jaff
1a05f8d9e2 UI QA fixes 2025-05-31 09:41:22 -07:00
Ishaan Jaff
68fd17d15e
[Fix] QA Fixes - Vector Store Object Permissions (#11291) 
* fix: QA for key,team,org permissions

* fix: add_vector_store_to_registry

* fix: refactor bedrock guard

* fix: refactor using us east 1 with vector stores

* fix: code QA checks

* fix: testing for mgmt endpoints
 2025-05-31 09:41:05 -07:00
Adam Holmberg
e0daa3da68
Make gemini stream thinking as reasoning_content (#11290) 
When "Thought": True, return text as reasoning_content instead of
content.

fixes #10563
fixes #11000
 2025-05-31 09:13:00 -07:00
Krrish Dholakia
51f716c762 build(VLLM-Passthrough-with-loadbalancing-support-(enables-using-model-list-for-VLLM-/classify-endpoint)): Closes #11205 2025-05-31 09:00:04 -07:00
மனோஜ்குமார் பழனிச்சாமி
0fd4ee2f94
Increase timeout (#11288) 2025-05-31 07:31:14 -07:00
Bryan Low
d77b825814
Swap Cohere and Cohere Chat provider (#11173) 
* fix cohere rerank provider

* swap cohere and cohere chat
 2025-05-31 01:20:37 -07:00
Shuai Zhang
712e042aa4
fix(secret-managers): Break AzureCredentialType restriction on AZURE_CREDENTIAL (#11272) 2025-05-31 01:03:08 -07:00
VigneshwarRajasekaran
9df61ef08b
Wrong parameter mapping for "frequency_penalty" to "repeat_penalty" in Ollama/completion/transformation.py (#11284) 2025-05-31 00:58:19 -07:00
Ishaan Jaff
15ea80d2cf ui new build 2025-05-30 23:08:07 -07:00
Ishaan Jaff
c5873c6f1f UI QA fixes/cleanup 2025-05-30 23:06:45 -07:00
Ishaan Jaff
310d97c982 fix: fix linting error 2025-05-30 22:51:10 -07:00
Ishaan Jaff
d7f19bbfe3
[Bug]: Performance Fix Max langfuse clients reached: 20 is greater than 20 (#11285) 
* fix: initializing langfuse clients

* fix: initializing langfuse clients

* tests: tests for langfuse cache
 2025-05-30 22:34:39 -07:00
Ishaan Jaff
7e49b4e2a0
[Feat] Enforce Vector Store Access Controls on LiteLLM Auth (#11281) 
* fix LiteLLM_ObjectPermissionTable

* fix include object_permission for list key

* fix key list to inclue obj permissions

* fix object permissions for vector stores on key info

* add key edit view with vector stores

* allow editing vector stores permissions

* fixes obj permissions

* feat: add obj permission on UI

* fix: add object_permission:true

* ui show org vector stores on org info

* fix: show object permissions on /org/info

* feat: allow updating obj permissions for keys

* fixes: key object permissions

* fixes: team object permissions

* fixes: org object permissions

* fix vector store selector for Orgs

* feat: add auth checks for vector store permissions

* feat: working auth checks for vector store permissions

* test vector stores auth checks

* Update litellm/proxy/_types.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: linting

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-05-30 22:20:11 -07:00
Ishaan Jaff
2f8eb1dcc3
fix: dont require mcp pip for proxy (#11282) 2025-05-30 22:19:53 -07:00
Isaac Whitfield
c698cc24aa
Streamline session expiration in UI (#11279) 2025-05-30 17:26:23 -07:00
Ishaan Jaff
a9d23f5d4a
[Fix] Bedrock Guard Auth Param Persistence (#11270) 
* fix: using bedrock guard

* fix: bedrock guard param persistence
 2025-05-30 17:24:03 -07:00
Ishaan Jaff
ea841eeb9b
[Feat] UI - show vector store permissions for Key, Team, Org (#11277) 
* fix LiteLLM_ObjectPermissionTable

* fix include object_permission for list key

* fix key list to inclue obj permissions

* fix object permissions for vector stores on key info

* add key edit view with vector stores

* allow editing vector stores permissions

* fixes obj permissions

* feat: add obj permission on UI

* fix: add object_permission:true

* ui show org vector stores on org info

* fix: show object permissions on /org/info

* feat: allow updating obj permissions for keys

* fixes: key object permissions

* fixes: team object permissions

* fixes: org object permissions

* fix vector store selector for Orgs
 2025-05-30 17:23:50 -07:00
Ishaan Jaff
b13d1b3ff1 ci/cd: run again 2025-05-30 09:06:03 -07:00
Krish Dholakia
44a69421ea
Anthropic - Files API w/ form-data support on passthrough + File ID support on /chat/completion (#11256) 
* fix(anthropic/chat): support passing 'file_id' param to anthropic

Partial fix for LIT-200

* feat(anthropic/chat): use correct anthropic content block based on file object

* fix(anthropic/chat): fix file id for container_upload message type

* fix(anthropic/chat/transformation.py): fix check for adding code execution to tool calls - needed for 'container_upload' message type

* fix(llm_passthrough_endpoints.py): support reading form data for anthropic passthrough

* refactor(llm_passthrough_endpoints.py): refactor block into function for easier testing

* test: add unit test

* fix: don't pass in empty tools list

* [Fix] Responses API - Session management  (#11254)

* fix: import session handling

* fix: imports for session handler

* tests: tests for session handler

* Update enterprise/litellm_enterprise/enterprise_callbacks/session_handler.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* bump: bump litellm enterprise

* fixes: test_create_user_default_budget

* fix: fix linting error

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-05-29 23:54:24 -07:00
Krish Dholakia
5d4ae9aa4d
Support dropping non-openai params when specified in additional_drop_params + Add VertexAI Anthropic support on /v1/messages (#11246) 
* feat(utils.py): support dropping non-openai params when specified via additional drop params

Closes https://github.com/BerriAI/litellm/issues/11205

* fix(utils.py): fix linting error

* refactor(handler.py): add custom llm provider to anthropic messages provider config exception

* feat: initial commit adding vertex ai anthropic support on `/v1/messages`

* test: add working unit test

* test(vertex_ai_partner_models/anthropic): add /v1/messages support for anthropic api

Adds vertex ai auth

* feat(vertex_ai/anthropic): return correct url when calling via `/v1/messages`

* fix: more alignment to expected anthropic request format

* fix: fix ruff linting check

* Removed syntax error from docs (#11242)

* [Feat]: Add Bedrock InvokeAgents as a /chat/completions route on LiteLLM (#11239)

* feat: init structure for bedrock AGENTs

* feat: add basic  routing for bedrock AGENTs

* feat: add basic transforms for bedrock AGENTs

* fix: url for bedrock agent runtime

* fix: working agents request

* feat: working agents non-streaming request

* feat: bedrock agents

* feat: add streaming for bedrock agents

* feat: add cost tracking for bedrock agents

* docs litellm with bedrock agents

* fix: linting errors

* test: invoke agents tests

* fix: import session handling

* Revert "fix: import session handling"

This reverts commit deb257dc10.

* fix: linting pin mypy

* [Feat]: Guardrails - Add streaming for bedrock post guard (#11247)

* feat: add streaming for bedrock post guard

* fix: bedrock guardrails

* fix: add clear comments

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: clean up bedrock guardrails

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* [Fix] Responses API - Session management  (#11254)

* fix: import session handling

* fix: imports for session handler

* tests: tests for session handler

* Update enterprise/litellm_enterprise/enterprise_callbacks/session_handler.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* bump: bump litellm enterprise

* fixes: test_create_user_default_budget

* fix: fix linting error

* fix: fix linting error

---------

Co-authored-by: Fadil Rahman <87557055+fadil4u@users.noreply.github.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-05-29 23:42:48 -07:00
Ishaan Jaff
c9062ac044 fixes: test_create_user_default_budget 2025-05-29 21:12:28 -07:00
Ishaan Jaff
afb75dc50c bump: bump litellm enterprise 2025-05-29 20:41:03 -07:00
Ishaan Jaff
7fcbb38d91
[Fix] Responses API - Session management (#11254) 
* fix: import session handling

* fix: imports for session handler

* tests: tests for session handler

* Update enterprise/litellm_enterprise/enterprise_callbacks/session_handler.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-05-29 20:36:02 -07:00
Ishaan Jaff
f24d8919c4
[Feat]: Guardrails - Add streaming for bedrock post guard (#11247) 
* feat: add streaming for bedrock post guard

* fix: bedrock guardrails

* fix: add clear comments

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: clean up bedrock guardrails

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-05-29 20:01:44 -07:00
Ishaan Jaff
62a083de02 fix: linting pin mypy 2025-05-29 19:58:31 -07:00
Ishaan Jaff
0d4c85c419 Revert "fix: import session handling" 
This reverts commit deb257dc10.
 2025-05-29 17:54:24 -07:00
Ishaan Jaff
deb257dc10 fix: import session handling 2025-05-29 17:48:34 -07:00
Ishaan Jaff
5e6f6ddc52
[Feat]: Add Bedrock InvokeAgents as a /chat/completions route on LiteLLM (#11239) 
* feat: init structure for bedrock AGENTs

* feat: add basic  routing for bedrock AGENTs

* feat: add basic transforms for bedrock AGENTs

* fix: url for bedrock agent runtime

* fix: working agents request

* feat: working agents non-streaming request

* feat: bedrock agents

* feat: add streaming for bedrock agents

* feat: add cost tracking for bedrock agents

* docs litellm with bedrock agents

* fix: linting errors

* test: invoke agents tests
 2025-05-29 16:48:55 -07:00
Fadil Rahman
dd8d23be62
Removed syntax error from docs (#11242) 2025-05-29 15:34:16 -07:00
Krrish Dholakia
368e59181d docs(entity_usage.tsx): fix bad link 2025-05-29 11:00:18 -07:00
AnilAren
9a82a69593
fix: bedrock ai21 jamba models will work now (#11233) 2025-05-29 08:31:05 -07:00
VigneshwarRajasekaran
974c928672
changed model name is request and updating to latest response format in proxy quick start guide as 3.5 turbo is retired and leads to error when a call is made using liteLLM to respective Azure-openAI endpoints. (#11223) 2025-05-29 08:27:56 -07:00
Emmanuel Ferdman
7dcfde2a1c
fix the litellm CLA reference (#11230) 
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
 2025-05-29 08:27:14 -07:00
Krrish Dholakia
dececb84c1 docs(image_edits.md): clarify proxy version support for image edits 2025-05-29 07:50:41 -07:00
Krrish Dholakia
077b69eafa fix(key_management_endpoints.py): allow master key rotations for OSS users 
Closes https://github.com/BerriAI/litellm/issues/11210
 2025-05-28 22:56:25 -07:00
Krish Dholakia
8fb2779c9e
build(model_prices_and_context_window.json): add supports parallel function calling to all gemini models (#11225) 2025-05-28 22:32:02 -07:00
Krish Dholakia
1995c7aad5
fix(utils.py): support non default params for audio transcription (#11212) 
* fix(utils.py): support non default params for audio transcription

allows passing provider specific params straight through on transcription calls

* fix(gpt_transformation.py): fix o_series model routing

call _transform_request on async event

* refactor: refactor tests

* test(test_azure_chat_o_series_transformation.py): add unit test for azure o series error

* test: update test

* test: update json

* fix: fix mutiple keyword error
 2025-05-28 22:24:02 -07:00
Krish Dholakia
ba39f9e360
Helicone base url support + fix for embedding cache hits on str input (#11211) 
* fix(helicone.py): add helicone api base support

Fixes https://github.com/BerriAI/litellm/issues/10825

* test: add unit test for cache hit response on embedding calls

* fix(caching_handler.py): fix handling cache hit on embedding when input is string

Fixes LIT-197

* docs(helicone_integration.md): document new helicone api base param
 2025-05-28 22:02:55 -07:00
Krrish Dholakia
75f591a6e2 docs(cli.md): add new skip_server_startup flag 2025-05-28 21:47:08 -07:00
Ishaan Jaff
2e5f635803 bump: version 1.71.2 → 1.71.3 2025-05-28 21:39:14 -07:00
Ishaan Jaff
2372492237 test: fix test_user_email_metrics 2025-05-28 21:30:47 -07:00