Commit graph

24591 commits

Author SHA1 Message Date
Ryan Means
a05330fcd8 Fix unit tests 2025-08-18 12:00:03 -07:00
Ryan Means
223587179f Update Pangea Guardrail to support new AIDR endpoint 2025-08-18 12:00:03 -07:00
Thiago Salvatore
169a17400f
fix(vertexai-batch): fix vertexai batch file format (#13576)
* fix(access group): allow access group on mcp tool retrieval

* fix(test): fix broken tests and add test case for access group

* fix(mypy): fix typing issues

* fix(memory file): add content type to in memory file
2025-08-18 10:19:23 -07:00
Ishaan Jaff
eee93e250a docs v1.75.5-stable 2025-08-18 09:23:18 -07:00
superpoussin22
b42df63d17
does not support function (#13612) 2025-08-18 08:45:25 -07:00
Michal Otmianowski
405e74ec16 use namespace as prefix in s3 2025-08-18 13:43:51 +02:00
TensorNull
159cfe5b4c
Merge branch 'BerriAI:main' into main 2025-08-18 09:46:12 +08:00
Krish Dholakia
c99277c517
Merge pull request #13694 from BerriAI/litellm_dev_08_16_2025_p3
Litellm dev 08 16 2025 p3
2025-08-17 13:02:17 -07:00
Tim Elfrink
0febdf8c1c feat: add thinking and reasoning parameter support for GitHub Copilot provider
- Add dynamic parameter support for anthropic models through GitHub Copilot
- Include thinking parameter for anthropic model compatibility
- Support reasoning_effort parameter for both anthropic and reasoning models
- Update test coverage for parameter validation logic
- Ensure proper parameter filtering based on model type
2025-08-17 17:51:58 +02:00
Tim Elfrink
d92092f040 formatting 2025-08-17 17:26:59 +02:00
Tim Elfrink
1e81a1bd7c feat: Add thinking and reasoning_effort parameter support for GitHub Copilot provider
- Add github_copilot case to get_supported_openai_params function
- Implement get_supported_openai_params method in GithubCopilotConfig
- Dynamically add thinking and reasoning_effort params for Anthropic models
- Add comprehensive tests for parameter support validation
- Ensure case-insensitive model detection for parameter inclusion

Fixes UnsupportedParamsError when using advanced reasoning parameters
with Anthropic models through GitHub Copilot proxy.
2025-08-17 17:13:29 +02:00
Ishaan Jaff
6c4ced275d ui new build 2025-08-16 19:08:18 -07:00
Ishaan Jaff
5c4ba732a6
fix client side exception (#13684) 2025-08-16 19:04:06 -07:00
tanjiro
ecb0b0ff53 search by public model name 2025-08-17 10:38:21 +09:00
tanjiro
b8a70e41cc preset azure provider 2025-08-17 10:06:58 +09:00
Krrish Dholakia
21549a3463 docs(index.md): write up on session management 2025-08-16 17:55:18 -07:00
Krrish Dholakia
cb95f2d5d7 docs(index.md): clarify risk of upgrade 2025-08-16 17:38:50 -07:00
Krrish Dholakia
788a1d03a1 docs(index.md): cleanup 2025-08-16 17:33:07 -07:00
Krrish Dholakia
235b6b040f docs(index.md): add highlight note on redis latency improvements 2025-08-16 17:32:45 -07:00
Krrish Dholakia
8a75ab8388 docs(index.md): cleanup doc 2025-08-16 17:16:04 -07:00
Krrish Dholakia
737a36558c feat(llm_http_handler.py): add OTEL tracing for actual llm api call
detailed latency tracing
2025-08-16 15:42:30 -07:00
Krrish Dholakia
3c9eb9bce9 build: update .gitignore 2025-08-16 15:19:04 -07:00
Krish Dholakia
50dec7cdee
Merge pull request #13682 from BerriAI/litellm_stable_release_fixes
Litellm stable release fixes
2025-08-16 15:10:55 -07:00
Krrish Dholakia
e035efeec7 fix(public_model_hub.tsx): fix ui 2025-08-16 14:30:26 -07:00
Krrish Dholakia
6322aef0e3 fix(streaming_handler.py): fix streaming chunk calculation 2025-08-16 14:25:29 -07:00
Krrish Dholakia
eb66daeef7 test: update test
we now return correct token usage on clientside
2025-08-16 14:14:35 -07:00
Ishaan Jaff
d96df5e9be Revert "test_stream_token_counting_anthropic_with_include_usage"
This reverts commit c3aee1194b.
2025-08-16 13:07:00 -07:00
Ishaan Jaff
c3aee1194b test_stream_token_counting_anthropic_with_include_usage 2025-08-16 13:06:31 -07:00
Krrish Dholakia
8bb5ee2ba5 test: update unit test 2025-08-16 12:39:03 -07:00
Krrish Dholakia
1ec0808713 test: update test - anthropic returns input tokens in final usage chunk now 2025-08-16 12:31:52 -07:00
Krish Dholakia
73f89d51a1
Merge pull request #13629 from BerriAI/budget-duration
Edit Budget Duration + Other Improvements in User Settings
2025-08-16 11:19:07 -07:00
Ishaan Jaff
5889311b10
[Docs] v1.75.8-stable (#13676)
* v1-75-8

* fix responses API docs

* docs fix

* docs fix new models

* docs links

* docs fix links

* docs sambanova

* docs fix
2025-08-16 09:20:04 -07:00
Ishaan Jaff
f522f40228 test_passing_tool_result_as_list 2025-08-16 08:08:25 -07:00
Ishaan Jaff
76939c5e73 ui new build 2025-08-16 07:59:18 -07:00
Ishaan Jaff
cac27be56a bump: version 1.75.7 → 1.75.8 2025-08-16 07:58:17 -07:00
Cole McIntosh
000ecad4e2 Fix Groq streaming ASCII encoding issue
Replace iter_lines()/aiter_lines() with iter_text()/aiter_text() using explicit
UTF-8 encoding to handle non-ASCII characters like µ in streaming responses.

- Added utf8_iter_lines() and utf8_aiter_lines() helper functions
- Ensures proper UTF-8 decoding of streaming response content
- Added comprehensive tests for Unicode character handling

Fixes #12660
2025-08-16 08:32:22 -05:00
Krrish Dholakia
5b641380ab fix(openai/responses/transformation.py): update supported openai params 2025-08-16 01:49:54 -07:00
Krrish Dholakia
b5c4ee60bb fix(openai/image_edits): Support 'mask' parameter for openai image edits
Closes https://github.com/BerriAI/litellm/issues/13528
2025-08-16 01:40:24 -07:00
Krish Dholakia
1b2ec16eee
Merge pull request #13640 from yytdfc/fix_bedrock_epc
[Bug Fix] Add cachePoint support for assistant and tool messages in Bedrock
2025-08-16 01:20:28 -07:00
Krrish Dholakia
675d73fb9b fix(mistral/chat/transformation.py): Support new mistral thinking block
Closes https://github.com/BerriAI/litellm/issues/13416
2025-08-16 01:16:01 -07:00
Krrish Dholakia
ff7bdb6290 fix(mistral/chat/transformation.py): handle empty message content for mistral calls
Fixes https://github.com/BerriAI/litellm/issues/13355
2025-08-16 00:41:11 -07:00
Krrish Dholakia
b83b1686c2 feat(support-allowed_openai_params-for-responses-api): Fixes https://github.com/BerriAI/litellm/issues/13559 2025-08-16 00:23:37 -07:00
Ishaan Jaff
40395598da
[Feat] UI - Allow editing team member rpm/tpm limits (#13669)
* show team member tpm/rpm limits

* ui - allow setting team settings

* fix better debugging

* fix types: TeamMemberUpdateRequest

* add _upsert_budget_and_membership

* allow updating team member RPM/TPM in teamMemberUpdateCall

* editing team member rpm/tpm

* UI - fixes for team member component

* fix info

* test_upsert_rpm_only_creates_new_budget
2025-08-15 17:29:44 -07:00
0x-fang
9f17bedb48
bump up boto3 and aioboto3 versions (#13665) 2025-08-15 17:06:08 -07:00
Ishaan Jaff
38e5af3580
[Feat] UI QA for Team Member Rate Limits (#13664)
* show team member tpm/rpm limits

* ui - allow setting team settings

* fix better debugging
2025-08-15 16:21:11 -07:00
Ishaan Jaff
4a10eeb75e
[Feat] Team Member Rate Limits - show team member tpm/rpm limits (#13662)
* show team member tpm/rpm limits

* ui - allow setting team settings
2025-08-15 12:18:13 -07:00
Ishaan Jaff
f5a1c14929 Revert "update boto3 version to 1.37.38 (#13656)"
This reverts commit 6f2264a13d.
2025-08-15 11:24:59 -07:00
Ishaan Jaff
c331473b75 Revert "fix aioboto3"
This reverts commit 82d1cb48b7.
2025-08-15 11:24:50 -07:00
Ishaan Jaff
49bef09a3a Revert "fix aioboto3"
This reverts commit 92c638ec59.
2025-08-15 11:24:41 -07:00
Ishaan Jaff
92c638ec59 fix aioboto3 2025-08-15 11:19:21 -07:00