Krish Dholakia
04feaf33c0
Merge pull request #13748 from hakasecurity/migrate-to-aim-new-firewall-api
...
Migrate to aim new firewall api
2025-08-19 22:32:22 -07:00
Krish Dholakia
be30bc68ae
Merge pull request #13759 from kankute-sameer/litellm_feat_correct_cost_calculations
...
Add long context support for claude-4-sonnet
2025-08-19 22:30:25 -07:00
Krrish Dholakia
7d09375d52
fix: fix gpt-5-chat mappings
2025-08-19 22:21:00 -07:00
Ishaan Jaff
56ac778316
[Bug Fix] Bedrock KB - Using LiteLLM Managed Credentials for Query ( #13787 )
...
* fix: add get_credentials_for_vector_store
* test_search_uses_registry_credentials
* test_bedrock_search_with_credentials_managed_registry
2025-08-19 15:39:36 -07:00
Sameer Kankute
48622a4ee7
add cache above 200k keys in INTENDED_SCHEMA
2025-08-20 01:47:34 +05:30
Sameer Kankute
fa81b6c639
Update test_cost_calculator.py
2025-08-19 23:14:22 +05:30
Ishaan Jaff
195ea6515e
[Feat] Datadog LLM Observability - Add support for tracing guardrail input/output ( #13767 )
...
* add guardrail information on DD LLM Obs
* test_guardrail_information_in_metadata
2025-08-19 10:26:25 -07:00
Sameer Kankute
b5f0a7b49b
Merge branch 'main' into litellm_feat_correct_cost_calculations
2025-08-19 18:55:36 +05:30
Sameer Kankute
d39b2e8888
Add test for long context cost calculation
2025-08-19 16:56:13 +05:30
drorbaron
6b78ade918
migrate to use new aim FW API
2025-08-19 12:20:19 +03:00
openhands
93651c9da7
Revert "Revert "fix: role chaining and session name with webauthentication for aws be…" ( #13230 )"
...
This reverts commit 342fd2d8b6
2025-08-19 08:19:18 +00:00
Tim Elfrink
b5fa2ee73f
Merge remote-tracking branch 'origin/main' into feat/github-copilot-thinking-reasoning-support
2025-08-19 10:11:59 +02:00
Tim Elfrink
9b0fda7b14
fix: resolve case sensitivity and test failures for extended thinking support
...
- Fix supports_reasoning() call to use lowercase model names for proper lookup
- Remove custom_llm_provider parameter as model registry entries are provider-agnostic
- Update tests to use full model names with date stamps (required for supports_reasoning)
- Add test coverage for models without extended thinking support
2025-08-19 08:40:10 +02:00
Krish Dholakia
88e52c55d0
Merge pull request #13675 from colesmcintosh/fix/groq-streaming-encoding
...
Fix Groq streaming ASCII encoding issue
2025-08-18 23:00:00 -07:00
Krish Dholakia
9dadd279a4
Merge pull request #13741 from BerriAI/litellm_dev_08_18_2025_p1
...
Refactor - forward model group headers - reuse same logic as global header forwarding
2025-08-18 22:58:39 -07:00
Krrish Dholakia
2c0520635d
test: cleanup old tests
2025-08-18 22:58:29 -07:00
Krish Dholakia
048f22b7ec
Merge pull request #13742 from BerriAI/litellm_dev_08_18_2025_p2
...
Fix - gemini prompt caching cost calculation
2025-08-18 22:54:28 -07:00
Krish Dholakia
3713c926c0
Merge pull request #13704 from michal-otmianowski/use-namespace-as-prefix-for-s3-cache
...
Use namespace as prefix for s3 cache
2025-08-18 22:37:18 -07:00
Krrish Dholakia
f7f1a0d0b7
test: add unit test
2025-08-18 22:32:36 -07:00
Krrish Dholakia
2e16f2cb13
test: add unit tests
2025-08-18 21:19:43 -07:00
Krish Dholakia
422447b7f1
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses
...
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
2025-08-18 18:59:28 -07:00
Krish Dholakia
3b52545db3
Merge pull request #13529 from BerriAI/litellm_dev_08_11_2025_p1
...
[Fix] Cooldowns - don't return raw Azure Exceptions to client
2025-08-18 18:54:19 -07:00
Ishaan Jaff
ba0881d728
[Bug Fix] image_edit() function returns APIConnectionError with litellm_proxy - Support for both image edits and image generations ( #13735 )
...
* add image edits litellm proxy on SDK
* add image gen provider
* add IMG Gen support for litellm_proxy provider
2025-08-18 18:26:32 -07:00
Ishaan Jaff
76f1064229
[Bug Fix] litellm incompatible with newest release of openAI v1.100.0 ( #13728 )
...
* fix imports OpenAI SDK
* ResponseText fixes
* fixes ResponseText
* fix imports
* catch AttributeError
* fix import
* use openai==1.100.1
* fix build from PIP
* fix lint test
* Print OpenAI version
* fix Install dependencies
2025-08-18 18:26:17 -07:00
Ishaan Jaff
ba1d2e8749
[Feat] DD LLM Observability - Add time to first token, litellm overhead, guardrail overhead latency metrics ( #13734 )
...
* fixes for DDLLMObsLatencyMetrics
* use _get_latency_metrics
* DD LLM Obs - track latency metrics
* fixes for bedrock guardrails
* DD unit tests
* test DD
2025-08-18 17:38:04 -07:00
Ishaan Jaff
ef08e18c66
[Feat] Datadog LLM Observability - Add support for Failure Logging ( #13726 )
...
* add async_log_failure_event for DD LLM Obs
* update types
* DataDogLLMObsLogger add failure logging support
* test_async_log_failure_event
* dd test failure
2025-08-18 15:19:48 -07:00
Ryan Means
a05330fcd8
Fix unit tests
2025-08-18 12:00:03 -07:00
Thiago Salvatore
169a17400f
fix(vertexai-batch): fix vertexai batch file format ( #13576 )
...
* fix(access group): allow access group on mcp tool retrieval
* fix(test): fix broken tests and add test case for access group
* fix(mypy): fix typing issues
* fix(memory file): add content type to in memory file
2025-08-18 10:19:23 -07:00
Michal Otmianowski
405e74ec16
use namespace as prefix in s3
2025-08-18 13:43:51 +02:00
Tim Elfrink
0febdf8c1c
feat: add thinking and reasoning parameter support for GitHub Copilot provider
...
- Add dynamic parameter support for anthropic models through GitHub Copilot
- Include thinking parameter for anthropic model compatibility
- Support reasoning_effort parameter for both anthropic and reasoning models
- Update test coverage for parameter validation logic
- Ensure proper parameter filtering based on model type
2025-08-17 17:51:58 +02:00
Tim Elfrink
1e81a1bd7c
feat: Add thinking and reasoning_effort parameter support for GitHub Copilot provider
...
- Add github_copilot case to get_supported_openai_params function
- Implement get_supported_openai_params method in GithubCopilotConfig
- Dynamically add thinking and reasoning_effort params for Anthropic models
- Add comprehensive tests for parameter support validation
- Ensure case-insensitive model detection for parameter inclusion
Fixes UnsupportedParamsError when using advanced reasoning parameters
with Anthropic models through GitHub Copilot proxy.
2025-08-17 17:13:29 +02:00
Krrish Dholakia
6322aef0e3
fix(streaming_handler.py): fix streaming chunk calculation
2025-08-16 14:25:29 -07:00
Krrish Dholakia
eb66daeef7
test: update test
...
we now return correct token usage on clientside
2025-08-16 14:14:35 -07:00
Ishaan Jaff
d96df5e9be
Revert "test_stream_token_counting_anthropic_with_include_usage"
...
This reverts commit c3aee1194b
2025-08-16 13:07:00 -07:00
Ishaan Jaff
c3aee1194b
test_stream_token_counting_anthropic_with_include_usage
2025-08-16 13:06:31 -07:00
Krrish Dholakia
8bb5ee2ba5
test: update unit test
2025-08-16 12:39:03 -07:00
Krrish Dholakia
1ec0808713
test: update test - anthropic returns input tokens in final usage chunk now
2025-08-16 12:31:52 -07:00
Ishaan Jaff
f522f40228
test_passing_tool_result_as_list
2025-08-16 08:08:25 -07:00
Cole McIntosh
000ecad4e2
Fix Groq streaming ASCII encoding issue
...
Replace iter_lines()/aiter_lines() with iter_text()/aiter_text() using explicit
UTF-8 encoding to handle non-ASCII characters like µ in streaming responses.
- Added utf8_iter_lines() and utf8_aiter_lines() helper functions
- Ensures proper UTF-8 decoding of streaming response content
- Added comprehensive tests for Unicode character handling
Fixes #12660
2025-08-16 08:32:22 -05:00
Krrish Dholakia
5b641380ab
fix(openai/responses/transformation.py): update supported openai params
2025-08-16 01:49:54 -07:00
Krrish Dholakia
b5c4ee60bb
fix(openai/image_edits): Support 'mask' parameter for openai image edits
...
Closes https://github.com/BerriAI/litellm/issues/13528
2025-08-16 01:40:24 -07:00
Krish Dholakia
1b2ec16eee
Merge pull request #13640 from yytdfc/fix_bedrock_epc
...
[Bug Fix] Add cachePoint support for assistant and tool messages in Bedrock
2025-08-16 01:20:28 -07:00
Krrish Dholakia
675d73fb9b
fix(mistral/chat/transformation.py): Support new mistral thinking block
...
Closes https://github.com/BerriAI/litellm/issues/13416
2025-08-16 01:16:01 -07:00
Krrish Dholakia
ff7bdb6290
fix(mistral/chat/transformation.py): handle empty message content for mistral calls
...
Fixes https://github.com/BerriAI/litellm/issues/13355
2025-08-16 00:41:11 -07:00
Krrish Dholakia
b83b1686c2
feat(support-allowed_openai_params-for-responses-api): Fixes https://github.com/BerriAI/litellm/issues/13559
2025-08-16 00:23:37 -07:00
Ishaan Jaff
40395598da
[Feat] UI - Allow editing team member rpm/tpm limits ( #13669 )
...
* show team member tpm/rpm limits
* ui - allow setting team settings
* fix better debugging
* fix types: TeamMemberUpdateRequest
* add _upsert_budget_and_membership
* allow updating team member RPM/TPM in teamMemberUpdateCall
* editing team member rpm/tpm
* UI - fixes for team member component
* fix info
* test_upsert_rpm_only_creates_new_budget
2025-08-15 17:29:44 -07:00
0x-fang
9f17bedb48
bump up boto3 and aioboto3 versions ( #13665 )
2025-08-15 17:06:08 -07:00
Ishaan Jaff
f5a1c14929
Revert "update boto3 version to 1.37.38 ( #13656 )"
...
This reverts commit 6f2264a13d
2025-08-15 11:24:59 -07:00
Daniel Barker
47edecd5bc
Fixed incorrect key info endpoint ( #13633 )
2025-08-15 11:10:06 -07:00
0x-fang
6f2264a13d
update boto3 version to 1.37.38 ( #13656 )
2025-08-15 11:06:54 -07:00
