Ishaan Jaff
76f1064229
[Bug Fix] litellm incompatible with newest release of openAI v1.100.0 ( #13728 )
...
* fix imports OpenAI SDK
* ResponseText fixes
* fixes ResponseText
* fix imports
* catch AttributeError
* fix import
* use openai==1.100.1
* fix build from PIP
* fix lint test
* Print OpenAI version
* fix Install dependencies
2025-08-18 18:26:17 -07:00
Ishaan Jaff
ba1d2e8749
[Feat] DD LLM Observability - Add time to first token, litellm overhead, guardrail overhead latency metrics ( #13734 )
...
* fixes for DDLLMObsLatencyMetrics
* use _get_latency_metrics
* DD LLM Obs - track latency metrics
* fixes for bedrock guardrails
* DD unit tests
* test DD
2025-08-18 17:38:04 -07:00
Ishaan Jaff
ef08e18c66
[Feat] Datadog LLM Observability - Add support for Failure Logging ( #13726 )
...
* add async_log_failure_event for DD LLM Obs
* update types
* DataDogLLMObsLogger add failure logging support
* test_async_log_failure_event
* dd test failure
2025-08-18 15:19:48 -07:00
Thiago Salvatore
169a17400f
fix(vertexai-batch): fix vertexai batch file format ( #13576 )
...
* fix(access group): allow access group on mcp tool retrieval
* fix(test): fix broken tests and add test case for access group
* fix(mypy): fix typing issues
* fix(memory file): add content type to in memory file
2025-08-18 10:19:23 -07:00
Ishaan Jaff
eee93e250a
docs v1.75.5-stable
2025-08-18 09:23:18 -07:00
superpoussin22
b42df63d17
does not support function ( #13612 )
2025-08-18 08:45:25 -07:00
Michal Otmianowski
405e74ec16
use namespace as prefix in s3
2025-08-18 13:43:51 +02:00
Krish Dholakia
c99277c517
Merge pull request #13694 from BerriAI/litellm_dev_08_16_2025_p3
...
Litellm dev 08 16 2025 p3
2025-08-17 13:02:17 -07:00
Ishaan Jaff
6c4ced275d
ui new build
2025-08-16 19:08:18 -07:00
Ishaan Jaff
5c4ba732a6
fix client side exception ( #13684 )
2025-08-16 19:04:06 -07:00
tanjiro
ecb0b0ff53
search by public model name
2025-08-17 10:38:21 +09:00
tanjiro
b8a70e41cc
preset azure provider
2025-08-17 10:06:58 +09:00
Krrish Dholakia
21549a3463
docs(index.md): write up on session management
2025-08-16 17:55:18 -07:00
Krrish Dholakia
cb95f2d5d7
docs(index.md): clarify risk of upgrade
2025-08-16 17:38:50 -07:00
Krrish Dholakia
788a1d03a1
docs(index.md): cleanup
2025-08-16 17:33:07 -07:00
Krrish Dholakia
235b6b040f
docs(index.md): add highlight note on redis latency improvements
2025-08-16 17:32:45 -07:00
Krrish Dholakia
8a75ab8388
docs(index.md): cleanup doc
2025-08-16 17:16:04 -07:00
Krrish Dholakia
737a36558c
feat(llm_http_handler.py): add OTEL tracing for actual llm api call
...
detailed latency tracing
2025-08-16 15:42:30 -07:00
Krrish Dholakia
3c9eb9bce9
build: update .gitignore
2025-08-16 15:19:04 -07:00
Krish Dholakia
50dec7cdee
Merge pull request #13682 from BerriAI/litellm_stable_release_fixes
...
Litellm stable release fixes
2025-08-16 15:10:55 -07:00
Krrish Dholakia
e035efeec7
fix(public_model_hub.tsx): fix ui
2025-08-16 14:30:26 -07:00
Krrish Dholakia
6322aef0e3
fix(streaming_handler.py): fix streaming chunk calculation
2025-08-16 14:25:29 -07:00
Krrish Dholakia
eb66daeef7
test: update test
...
we now return correct token usage on clientside
2025-08-16 14:14:35 -07:00
Ishaan Jaff
d96df5e9be
Revert "test_stream_token_counting_anthropic_with_include_usage"
...
This reverts commit c3aee1194b
2025-08-16 13:07:00 -07:00
Ishaan Jaff
c3aee1194b
test_stream_token_counting_anthropic_with_include_usage
2025-08-16 13:06:31 -07:00
Krrish Dholakia
8bb5ee2ba5
test: update unit test
2025-08-16 12:39:03 -07:00
Krrish Dholakia
1ec0808713
test: update test - anthropic returns input tokens in final usage chunk now
2025-08-16 12:31:52 -07:00
Krish Dholakia
73f89d51a1
Merge pull request #13629 from BerriAI/budget-duration
...
Edit Budget Duration + Other Improvements in User Settings
2025-08-16 11:19:07 -07:00
Ishaan Jaff
5889311b10
[Docs] v1.75.8-stable ( #13676 )
...
* v1-75-8
* fix responses API docs
* docs fix
* docs fix new models
* docs links
* docs fix links
* docs sambanova
* docs fix
2025-08-16 09:20:04 -07:00
Ishaan Jaff
f522f40228
test_passing_tool_result_as_list
2025-08-16 08:08:25 -07:00
Ishaan Jaff
76939c5e73
ui new build
2025-08-16 07:59:18 -07:00
Ishaan Jaff
cac27be56a
bump: version 1.75.7 → 1.75.8
2025-08-16 07:58:17 -07:00
Cole McIntosh
000ecad4e2
Fix Groq streaming ASCII encoding issue
...
Replace iter_lines()/aiter_lines() with iter_text()/aiter_text() using explicit
UTF-8 encoding to handle non-ASCII characters like µ in streaming responses.
- Added utf8_iter_lines() and utf8_aiter_lines() helper functions
- Ensures proper UTF-8 decoding of streaming response content
- Added comprehensive tests for Unicode character handling
Fixes #12660
2025-08-16 08:32:22 -05:00
Krish Dholakia
1b2ec16eee
Merge pull request #13640 from yytdfc/fix_bedrock_epc
...
[Bug Fix] Add cachePoint support for assistant and tool messages in Bedrock
2025-08-16 01:20:28 -07:00
Ishaan Jaff
40395598da
[Feat] UI - Allow editing team member rpm/tpm limits ( #13669 )
...
* show team member tpm/rpm limits
* ui - allow setting team settings
* fix better debugging
* fix types: TeamMemberUpdateRequest
* add _upsert_budget_and_membership
* allow updating team member RPM/TPM in teamMemberUpdateCall
* editing team member rpm/tpm
* UI - fixes for team member component
* fix info
* test_upsert_rpm_only_creates_new_budget
2025-08-15 17:29:44 -07:00
0x-fang
9f17bedb48
bump up boto3 and aioboto3 versions ( #13665 )
2025-08-15 17:06:08 -07:00
Ishaan Jaff
38e5af3580
[Feat] UI QA for Team Member Rate Limits ( #13664 )
...
* show team member tpm/rpm limits
* ui - allow setting team settings
* fix better debugging
2025-08-15 16:21:11 -07:00
Ishaan Jaff
4a10eeb75e
[Feat] Team Member Rate Limits - show team member tpm/rpm limits ( #13662 )
...
* show team member tpm/rpm limits
* ui - allow setting team settings
2025-08-15 12:18:13 -07:00
Ishaan Jaff
f5a1c14929
Revert "update boto3 version to 1.37.38 ( #13656 )"
...
This reverts commit 6f2264a13d
2025-08-15 11:24:59 -07:00
Ishaan Jaff
c331473b75
Revert "fix aioboto3"
...
This reverts commit 82d1cb48b7
2025-08-15 11:24:50 -07:00
Ishaan Jaff
49bef09a3a
Revert "fix aioboto3"
...
This reverts commit 92c638ec59
2025-08-15 11:24:41 -07:00
Ishaan Jaff
92c638ec59
fix aioboto3
2025-08-15 11:19:21 -07:00
Ishaan Jaff
82d1cb48b7
fix aioboto3
2025-08-15 11:19:14 -07:00
James Page
46e8e50b47
trivy/secrets false positives ( #13631 )
...
* alert_to_webhook_url: avoid secret false positive
Trivy detects the example as a potential secret; tweak the hostname
a bit to make it obviously not hooks.slack.com to avoid this.
* Remove log file
Drop log file checked into the git tree; this contains strings that
trivy detects as potential secrets.
2025-08-15 11:10:54 -07:00
Daniel Barker
47edecd5bc
Fixed incorrect key info endpoint ( #13633 )
2025-08-15 11:10:06 -07:00
William Finnigan
99f30fe5b7
Fix LangfuseOtelSpanAttributes constants to match expected values at https://python.reference.langfuse.com/langfuse#LangfuseOtelSpanAttributes ( #13659 )
...
- Update TRACE_USER_ID from 'langfuse.trace.user_id' to 'user.id'
- Update SESSION_ID from 'langfuse.trace.session_id' to 'session.id'
2025-08-15 11:08:32 -07:00
0x-fang
6f2264a13d
update boto3 version to 1.37.38 ( #13656 )
2025-08-15 11:06:54 -07:00
Jugal Bhatt
790d2d0830
[Update] Adjust max_input_tokens for azure/gpt-5-chat models in JSON configuration
...
* Reduced max_input_tokens from 400000 to 272000 for both azure/gpt-5-chat and azure/gpt-5-chat-latest to optimize resource usage and align with updated model specifications.
2025-08-15 10:57:39 -07:00
Ishaan Jaff
c3608adb0f
[Bug Fix] Using stream=True + background=True with Responses API ( #13654 )
...
* test_update_responses_api_response_id_with_model_id_handles_dict
* fix linting
2025-08-15 08:58:28 -07:00
Ishaan Jaff
d6fa6b60d7
[Feat] UI - Add Confirmation Modal Before Deleting Keys ( #13655 )
...
* Enhance key deletion with confirmation input and improved modal UI
Co-authored-by: ishaan <ishaan@berri.ai>
* remove file
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-08-15 08:51:32 -07:00
