Ishaan Jaff
ed52b67fcf
test_image_edit_array_handling
2025-08-27 09:51:22 -07:00
Ishaan Jaff
d5440f9614
test_image_edit_array_handling
2025-08-27 08:27:57 -07:00
Ishaan Jaff
76f78f7b2a
fix: LITELLM_LOG_FILE test
2025-08-27 08:25:24 -07:00
Ifta Khairul Alam Adil
8808f78ba6
Merge branch 'main' into fix/gemini-imagen-model-name-validation
2025-08-27 15:45:59 +02:00
Krish Dholakia
900bd10905
Merge branch 'main' into feature/enhance_logging_for_containers
2025-08-26 23:21:15 -07:00
Krish Dholakia
71af7bcf9c
Merge pull request #13374 from blahgeek/fix-count-special-token
...
Fix token_counter with special token input
2025-08-26 23:19:26 -07:00
Krish Dholakia
45f465d84f
Merge pull request #13572 from Noma-Security/noma-security-guardrails-support
...
Add Noma Security guardrail support
2025-08-26 23:15:17 -07:00
Ifta Khairul Alam Adil
0f5b31fd78
fix: resolve invalid model name error for Gemini Imagen models ( #13851 )
...
- Fix URL construction in Gemini image generation to strip 'gemini/' prefix
- Google AI API expects base model name without the prefix
- Update model references and pricing information for consistency
- Remove outdated image generation pricing entries
Fixes issue where models like 'gemini/imagen-4.0-fast-generate-preview-06-06'
were being rejected by the Google AI API due to incorrect URL formatting.
2025-08-27 04:17:35 +02:00
Ishaan Jaff
ab7efaa832
test_pre_process_non_default_params ( #13990 )
2025-08-26 19:15:17 -07:00
Cole French
6696955506
[Bug]: Fix tests to reference moved attributes in braintrust_logging module ( #13978 )
...
* Mock instance attribute moved from globals
* Support looking up mock message on mock choice
2025-08-26 18:58:16 -07:00
Krish Dholakia
ae678a6642
Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata
...
Feature/braintrust span name metadata
2025-08-25 23:19:56 -07:00
Krish Dholakia
3ed1220f75
Merge pull request #13916 from mubashir1osmani/openai-multiple-images
...
feat: multiple images in openai images/edits endpoint
2025-08-25 23:11:13 -07:00
Krish Dholakia
22934907ba
Merge pull request #13933 from michal-otmianowski/ignore-expired-s3-cache-entries
...
Verify if cache entry has expired prior to serving it to client
2025-08-25 23:10:48 -07:00
Krish Dholakia
b1bc8e3aa2
Merge pull request #13955 from ckoehler/push-oymwkvxmkqxv
...
feat: add image headers for Copilot
2025-08-25 23:04:24 -07:00
Ishaan Jaff
6ce1d82970
[Bug] Fix: Vertex Mistral not working for streaming ( #13952 )
...
* fix OpenAI like chat handler
* fix MockResponse
* test_partner_models_httpx_streaming
* test_partner_models_httpx_streaming
2025-08-25 17:39:40 -07:00
Christoph Koehler
04cca1e7f3
feat: add image headers for Copilot
...
Fixes #13696 . See issue for details.
2025-08-25 18:15:26 -06:00
Ishaan Jaff
c7b0c57b1e
[Bug Fix] Azure Passthrough request with streaming ( #13831 )
...
* fix: _update_stream_param_based_on_request_body
* test_update_stream_param_based_on_request_body
* test_pass_through_request_stream_param_override
2025-08-25 14:11:17 -07:00
Ishaan Jaff
433d1a4947
[Bug fix] - Fix /messages fallback from Anthropic API -> Bedrock API ( #13946 )
...
* use helper get_provider_specific_headers
* fix get_provider_specific_headers
* test_anthropic_messages_fallbacks
* bedrock/us.anthropic.claude-sonnet-4
* fix: get_provider_specific_headers
* TestProviderSpecificHeaderUtils
* test_anthropic_messages_fallbacks
2025-08-25 13:44:54 -07:00
0x5751
8dd04c4eee
fix: test error
2025-08-26 01:58:04 +08:00
0x5751
d6cd50dfdb
feat: Add support for custom Anthropic-compatible API endpoints
...
This commit adds support for custom Anthropic-compatible API endpoints
that don't follow the standard /v1/messages or /v1/complete path convention.
## Changes
- Added LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX environment variable
- When set to true, prevents automatic appending of /v1/messages (for anthropic)
- When set to true, prevents automatic appending of /v1/complete (for anthropic_text)
- Added debug logging to indicate when suffix is being skipped
- Maintained full backward compatibility - existing deployments are unaffected
2025-08-26 01:22:51 +08:00
Michal Otmianowski
c444263e7d
verify expires field prior to serving cache entry
2025-08-25 10:42:12 +02:00
Steven Anton
d95578464e
Add support for AWS assume_role with a session token
2025-08-23 22:37:21 -07:00
Ishaan Jaff
e0e356e328
test mapped test fixes
2025-08-23 17:04:23 -07:00
mubashir1osmani
2fa8f971e0
feat: multiple images in openai images/edits endpoint
2025-08-23 19:13:32 -04:00
Ishaan Jaff
0fccd619ea
test_vertex_ai_deepseek
2025-08-23 14:13:03 -07:00
Ishaan Jaff
cf64033044
test fix
2025-08-23 14:04:41 -07:00
Ishaan Jaff
f1c710a608
test_e2e_generate_cold_storage_object_key_not_configured
2025-08-23 13:33:33 -07:00
Ishaan Jaff
b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS ( #13905 )
...
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895 )
* fix: litellm.configured_cold_storage_logger
* fix Session Management - Non-OpenAI Models docs
* ruff fix
* test fix
* create LoggingWorker
* add GLOBAL_LOGGING_WORKER for async task handling
* fix logging tests
* add conftest
* fix conftest
* test fix location of encode bedrock runtime modelid arn
* fix conftest.py
* tuning LoggingWorker
* conftest.py
* fix conftest batches/
* test_async_chat_azure
* event_loop
* test_bedrock_streaming_passthrough_test2
* fix GLOBAL_LOGGING_WORKER
* logging worker
* add flush for global logging worker
* Revert "fix GLOBAL_LOGGING_WORKER"
This reverts commit d254f508f4
2025-08-23 13:13:23 -07:00
Ishaan Jaff
9750374081
[Feat] New LLM API - AI/ML API for Image Gen ( #13893 )
...
* add LlmProviders.AIML
* add AIMLChatConfig
* add aiml
* fix AimlImageGenerationConfig
* add AimlImageGenerationConfig
* add cost_calculator
* fixes for AI ML API
* add known AIML Flux image models
* add AIML Cost Calc
* add AI/ML API
* add aiml_models
2025-08-23 13:12:44 -07:00
Krish Dholakia
9df6f4ef08
Merge branch 'main' into litellm_dev_08_20_2025_p1
2025-08-23 12:09:53 -07:00
Krrish Dholakia
b23e35f75e
test: update tests
2025-08-23 12:09:19 -07:00
Krish Dholakia
ef66bb87b3
Merge branch 'main' into litellm_dev_08_16_2025_p2
2025-08-23 11:30:51 -07:00
Krrish Dholakia
385bb15219
test: skip test
2025-08-23 11:27:46 -07:00
Krish Dholakia
06a2915e9f
Merge pull request #13671 from BerriAI/litellm_dev_08_15_2025_p1
...
Responses API - support `allowed_openai_params` + Mistral - handle empty assistant content + support new mistral 'thinking' response block
2025-08-23 11:15:23 -07:00
Krrish Dholakia
4d7433b5ad
test: reduce mistral direct tests b/c of rate limit errors
2025-08-23 11:15:03 -07:00
Krrish Dholakia
cbb161f10b
test: handle internal server errors
2025-08-23 11:00:18 -07:00
Krish Dholakia
f0b0ee51e0
Merge branch 'main' into litellm_dev_08_15_2025_p1
2025-08-23 10:51:56 -07:00
Krrish Dholakia
ba9f6894b7
test: update tests
2025-08-23 10:42:41 -07:00
Krish Dholakia
3e764ec268
Merge pull request #13808 from mainred/validate_api_version
...
feat(utils.py): accept 'api_version' as param for validate_environment
2025-08-22 23:59:38 -07:00
Krish Dholakia
867b48a24f
Merge pull request #13866 from jinskjoy/Mistral-File-ID
...
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-22 23:54:17 -07:00
Ishaan Jaff
825d6b08f0
test fix location of encode bedrock runtime modelid arn
2025-08-22 17:34:09 -07:00
Ishaan Jaff
56c16fc6f6
[Performance] Reduce Significant CPU overhead from litellm_logging.py ( #13895 )
...
* fix: litellm.configured_cold_storage_logger
* fix Session Management - Non-OpenAI Models docs
* ruff fix
* test fix
2025-08-22 16:17:57 -07:00
Jugal D. Bhatt
3c1dcb64cc
fix by adding init lock ( #13666 )
2025-08-22 11:42:43 -07:00
Krish Dholakia
dcad39c00f
Merge pull request #13753 from RichardoC/fix-bedrock-irsa-role-assumption
...
fix: role chaining and session name with webauthentication for aws bedrock
2025-08-22 07:20:27 -07:00
Krish Dholakia
59e43595b9
Merge pull request #13852 from michal-otmianowski/async-s3-implementation
...
Async s3 implementation
2025-08-21 23:19:51 -07:00
Krish Dholakia
8b45e53878
Merge pull request #13880 from datarobot-forks/carsongee/improve_datarobot_api_handling
...
🐛 Bug Fix: Updated URL handling for DataRobot provider URL
2025-08-21 23:18:40 -07:00
Krish Dholakia
9c4a86e98e
Merge pull request #13868 from kankute-sameer/litellm_feat_voyage_context_3_embedding_model
...
[Feat] Add support for voyage-context-3 embedding model
2025-08-21 23:18:20 -07:00
Krish Dholakia
6214d22126
Merge pull request #13863 from luizrennocosta/fix/pll-req-lim-v3-api-key
...
fix: fixing descriptor/response size mismatch on parallel_request_limiter_v3
2025-08-21 23:14:04 -07:00
Ishaan Jaff
e93e266f84
[Performance] Use O(1) Set lookups for model routing ( #13879 )
...
* o(1) lookups
* Revert "o(1) lookups"
This reverts commit 620d142469676a9f5bcc
2025-08-21 22:56:46 -07:00
Krish Dholakia
a61275f6e2
Merge pull request #13796 from 0x-fang/fix_aip_pass_through_08_20
...
Fix(Bedrock): fix application inference profile for pass-through endpoints for bedrock
2025-08-21 19:41:23 -07:00
