scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-05 08:07:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 136
24331 commits 4051 branches 1400 tags 4.1 GiB
Commit graph

2812 commits

Author SHA1 Message Date
Krish Dholakia
45f465d84f
Merge pull request #13572 from Noma-Security/noma-security-guardrails-support 
Add Noma Security guardrail support
 2025-08-26 23:15:17 -07:00
Ishaan Jaff
ab7efaa832
test_pre_process_non_default_params (#13990) 2025-08-26 19:15:17 -07:00
Cole French
6696955506
[Bug]: Fix tests to reference moved attributes in braintrust_logging module (#13978) 
* Mock instance attribute moved from globals

* Support looking up mock message on mock choice
 2025-08-26 18:58:16 -07:00
Krish Dholakia
ae678a6642
Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata 
Feature/braintrust span name metadata
 2025-08-25 23:19:56 -07:00
Krish Dholakia
3ed1220f75
Merge pull request #13916 from mubashir1osmani/openai-multiple-images 
feat: multiple images in openai images/edits endpoint
 2025-08-25 23:11:13 -07:00
Krish Dholakia
22934907ba
Merge pull request #13933 from michal-otmianowski/ignore-expired-s3-cache-entries 
Verify if cache entry has expired prior to serving it to client
 2025-08-25 23:10:48 -07:00
Krish Dholakia
b1bc8e3aa2
Merge pull request #13955 from ckoehler/push-oymwkvxmkqxv 
feat: add image headers for Copilot
 2025-08-25 23:04:24 -07:00
Ishaan Jaff
6ce1d82970
[Bug] Fix: Vertex Mistral not working for streaming (#13952) 
* fix OpenAI like chat handler

* fix MockResponse

* test_partner_models_httpx_streaming

* test_partner_models_httpx_streaming
 2025-08-25 17:39:40 -07:00
Christoph Koehler
04cca1e7f3
feat: add image headers for Copilot 
Fixes #13696. See issue for details.
 2025-08-25 18:15:26 -06:00
Ishaan Jaff
c7b0c57b1e
[Bug Fix] Azure Passthrough request with streaming (#13831) 
* fix: _update_stream_param_based_on_request_body

* test_update_stream_param_based_on_request_body

* test_pass_through_request_stream_param_override
 2025-08-25 14:11:17 -07:00
Ishaan Jaff
433d1a4947
[Bug fix] - Fix /messages fallback from Anthropic API -> Bedrock API (#13946) 
* use helper get_provider_specific_headers

* fix get_provider_specific_headers

* test_anthropic_messages_fallbacks

* bedrock/us.anthropic.claude-sonnet-4

* fix: get_provider_specific_headers

* TestProviderSpecificHeaderUtils

* test_anthropic_messages_fallbacks
 2025-08-25 13:44:54 -07:00
Michal Otmianowski
c444263e7d verify expires field prior to serving cache entry 2025-08-25 10:42:12 +02:00
Steven Anton
d95578464e Add support for AWS assume_role with a session token 2025-08-23 22:37:21 -07:00
Ishaan Jaff
e0e356e328 test mapped test fixes 2025-08-23 17:04:23 -07:00
mubashir1osmani
2fa8f971e0 feat: multiple images in openai images/edits endpoint 2025-08-23 19:13:32 -04:00
Ishaan Jaff
0fccd619ea test_vertex_ai_deepseek 2025-08-23 14:13:03 -07:00
Ishaan Jaff
cf64033044 test fix 2025-08-23 14:04:41 -07:00
Ishaan Jaff
f1c710a608 test_e2e_generate_cold_storage_object_key_not_configured 2025-08-23 13:33:33 -07:00
Ishaan Jaff
b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)

* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix

* create LoggingWorker

* add GLOBAL_LOGGING_WORKER for async task handling

* fix logging tests

* add conftest

* fix conftest

* test fix location of encode bedrock runtime modelid arn

* fix conftest.py

* tuning LoggingWorker

* conftest.py

* fix conftest batches/

* test_async_chat_azure

* event_loop

* test_bedrock_streaming_passthrough_test2

* fix GLOBAL_LOGGING_WORKER

* logging worker

* add flush for global logging worker

* Revert "fix GLOBAL_LOGGING_WORKER"

This reverts commit d254f508f4.

* fix conftest clear_queue

* fix conftest clear_queue

* setup_and_teardown for llm translation

* docs AWS_REGION

* test_async_chat_azure

* change test DIR

* run ci/cd again

* use 1 job for litellm_router_unit_testing

* fix space

* fix litellm_router_unit_testing

* test_aaarouter_dynamic_cooldown_message_retry_time

* litellm_router_unit_testing

* conftest.py clearing qu

* fixes litellm_router_unit_testing

* fixes clear_queue

* fix router_unit_tests

* remove conftest

* add back conftest for router

* fix event loop test

* test fix

* fixes for LoggingWorker

* ruff fix
 2025-08-23 13:13:23 -07:00
Ishaan Jaff
9750374081
[Feat] New LLM API - AI/ML API for Image Gen (#13893) 
* add LlmProviders.AIML

* add AIMLChatConfig

* add aiml

* fix AimlImageGenerationConfig

* add AimlImageGenerationConfig

* add cost_calculator

* fixes for AI ML API

* add known AIML Flux image models

* add AIML Cost Calc

* add AI/ML API

* add aiml_models
 2025-08-23 13:12:44 -07:00
Krish Dholakia
9df6f4ef08
Merge branch 'main' into litellm_dev_08_20_2025_p1 2025-08-23 12:09:53 -07:00
Krrish Dholakia
b23e35f75e test: update tests 2025-08-23 12:09:19 -07:00
Krish Dholakia
ef66bb87b3
Merge branch 'main' into litellm_dev_08_16_2025_p2 2025-08-23 11:30:51 -07:00
Krrish Dholakia
385bb15219 test: skip test 2025-08-23 11:27:46 -07:00
Krish Dholakia
06a2915e9f
Merge pull request #13671 from BerriAI/litellm_dev_08_15_2025_p1 
Responses API - support `allowed_openai_params` + Mistral - handle empty assistant content + support new mistral 'thinking' response block
 2025-08-23 11:15:23 -07:00
Krrish Dholakia
4d7433b5ad test: reduce mistral direct tests b/c of rate limit errors 2025-08-23 11:15:03 -07:00
Krrish Dholakia
cbb161f10b test: handle internal server errors 2025-08-23 11:00:18 -07:00
Krish Dholakia
f0b0ee51e0
Merge branch 'main' into litellm_dev_08_15_2025_p1 2025-08-23 10:51:56 -07:00
Krrish Dholakia
ba9f6894b7 test: update tests 2025-08-23 10:42:41 -07:00
Krish Dholakia
3e764ec268
Merge pull request #13808 from mainred/validate_api_version 
feat(utils.py): accept 'api_version' as param for validate_environment
 2025-08-22 23:59:38 -07:00
Krish Dholakia
867b48a24f
Merge pull request #13866 from jinskjoy/Mistral-File-ID 
[Enhancement] Add support for Mistral model file handling and update documentation
 2025-08-22 23:54:17 -07:00
Ishaan Jaff
825d6b08f0 test fix location of encode bedrock runtime modelid arn 2025-08-22 17:34:09 -07:00
Ishaan Jaff
56c16fc6f6
[Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895) 
* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix
 2025-08-22 16:17:57 -07:00
Jugal D. Bhatt
3c1dcb64cc
fix by adding init lock (#13666) 2025-08-22 11:42:43 -07:00
Krish Dholakia
dcad39c00f
Merge pull request #13753 from RichardoC/fix-bedrock-irsa-role-assumption 
fix: role chaining and session name with webauthentication for aws bedrock
 2025-08-22 07:20:27 -07:00
Krish Dholakia
59e43595b9
Merge pull request #13852 from michal-otmianowski/async-s3-implementation 
Async s3 implementation
 2025-08-21 23:19:51 -07:00
Krish Dholakia
8b45e53878
Merge pull request #13880 from datarobot-forks/carsongee/improve_datarobot_api_handling 
🐛 Bug Fix: Updated URL handling for DataRobot provider URL
 2025-08-21 23:18:40 -07:00
Krish Dholakia
9c4a86e98e
Merge pull request #13868 from kankute-sameer/litellm_feat_voyage_context_3_embedding_model 
[Feat] Add support for voyage-context-3 embedding model
 2025-08-21 23:18:20 -07:00
Krish Dholakia
6214d22126
Merge pull request #13863 from luizrennocosta/fix/pll-req-lim-v3-api-key 
fix: fixing descriptor/response size mismatch on parallel_request_limiter_v3
 2025-08-21 23:14:04 -07:00
Ishaan Jaff
e93e266f84
[Performance] Use O(1) Set lookups for model routing (#13879) 
* o(1) lookups

* Revert "o(1) lookups"

This reverts commit 620d142469.

* o(1) lookups

* Revert "o(1) lookups"

This reverts commit 676a9f5bcc.

* o(1) lookups

* register_model fix

* test_aget_valid_models

* lambda ai models fix

* test_utils.py

* test fix vertex ai
 2025-08-21 22:56:46 -07:00
Krish Dholakia
a61275f6e2
Merge pull request #13796 from 0x-fang/fix_aip_pass_through_08_20 
Fix(Bedrock): fix application inference profile for pass-through endpoints for bedrock
 2025-08-21 19:41:23 -07:00
Carson Gee
b46de0ab5c
Updated URL handling for DataRobot provider base 2025-08-21 19:42:46 -06:00
Krish Dholakia
7c2c1c11d9
Merge pull request #13783 from philipkiely-baseten/main 
Update Baseten LiteLLM integration
 2025-08-21 18:34:36 -07:00
Ishaan Jaff
77a5de37b1
[Fix] Ensure Service Account Keys require team_id field on API Endpoints (#13873) 
* fixes for generating service accounts through the API

* fixes for test_update_service_account_works_with_team_id
 2025-08-21 14:55:06 -07:00
Sameer Kankute
5ac4fb512c Add support for voyage-context-3 embedding model 2025-08-22 00:15:12 +05:30
jinskjoy
d8a33e137d [Enhancement] Add support for Mistral model file handling and update documentation 2025-08-21 20:35:07 +02:00
Philip Kiely
5fa4a18073 add testing and remove redundant function 2025-08-21 11:25:26 -07:00
Luiz Rennó Costa
f8711200d0 fix: fixing descriptor/response size difference when indexing descriptor 2025-08-21 13:43:23 -03:00
Michal Otmianowski
a6f052882b fix test 2025-08-21 12:10:29 +02:00
Michal Otmianowski
feae09da5d minor adjustments 2025-08-21 11:33:11 +02:00