Commit graph

25212 commits

Author SHA1 Message Date
Yuta Saito
a8059f80f4 feat: remove server_name prefix from list_tools when only one server is present (#14504) 2025-09-19 18:29:43 +09:00
Krish Dholakia
aa54994994
Merge pull request #14666 from michaeltansg/feat/add-bangkok-timezone
Added Indochina Time timezone support for budget resets
2025-09-18 23:41:27 -07:00
Krish Dholakia
f5838594e0
Merge pull request #14675 from tcx4c70/fix/response-price
fix: cost calculation for responses
2025-09-18 23:41:08 -07:00
Krish Dholakia
ad6ba8f5c5
Merge pull request #14695 from uc4w6c/fix/mcp-gateway-tools-list
Fix/mcp gateway tools list
2025-09-18 23:40:14 -07:00
Krish Dholakia
d5a839d971
Merge pull request #14700 from BerriAI/litellm_contributor_prs_09_18_2025_p2
Update Bedrock documentation for Titan V2 encoding_format support + Anthropic - account for 1h vs. 5m cache creation token cost difference + UI - add langsmith_sampling_rate as a dynamic param
2025-09-18 23:38:29 -07:00
Krrish Dholakia
92e841e311 fix: fix test 2025-09-18 23:37:38 -07:00
Krish Dholakia
b6d5a65fed
Merge pull request #14708 from mrFranklin/fix/opik-timezone
fix: timezone issue of opik
2025-09-18 23:35:27 -07:00
Ishaan Jaff
80bd8e007f
fix contributor PR linting failing (#14710)
* validate fix

* fix linting error
2025-09-18 20:03:27 -07:00
Krish Dholakia
9a6b1651d2
Merge pull request #14707 from ARajan1084/bedrock-guardrail-silent-failure-correction
fix: Bedrock guardrail silent failure correction
2025-09-18 20:03:17 -07:00
Krish Dholakia
9c7e1934cc
Merge pull request #14652 from BerriAI/litellm_dev_09_17_2025_p2_v2
Anthropic - account for 1h vs. 5m cache creation token cost difference + UI - add langsmith_sampling_rate as a dynamic param
2025-09-18 19:51:02 -07:00
Ishaan Jaffer
2249badd2f docs fix 2025-09-18 19:51:00 -07:00
Krish Dholakia
664c83cfb5
Merge branch 'litellm_contributor_prs_09_18_2025_p2' into litellm_dev_09_17_2025_p2_v2 2025-09-18 19:50:55 -07:00
=
14b3cc2f95 Update test_bedrock_guardrails.py 2025-09-18 19:48:16 -07:00
Franklin
f5785ae41b
fix: timezone issue of opik 2025-09-19 10:46:09 +08:00
Ishaan Jaffer
8139569975 docs fix 2025-09-18 19:46:08 -07:00
=
ed4bd504ea Revert "removed unnecessary test"
This reverts commit ad663e5240.
2025-09-18 19:45:13 -07:00
Krrish Dholakia
a93d6ce775 build(poetry.lock): git push origin 2025-09-18 19:44:38 -07:00
=
ad663e5240 removed unnecessary test 2025-09-18 19:37:15 -07:00
Ishaan Jaffer
725cf3627d fix: license check.ini 2025-09-18 19:28:07 -07:00
Krrish Dholakia
565eeca92a build(pyproject.toml): bump versions 2025-09-18 19:24:34 -07:00
Alexsander Hamir
b33d52c6e1
Added missing dependencies (#14706)
* fix: adding dependencies

* fix: added to required

* fix: remove from wrong place

* fix: misspelling
2025-09-18 19:20:24 -07:00
Krrish Dholakia
4d87199266 fix(prometheus.py): fix spend metrics 2025-09-18 19:12:07 -07:00
=
5eff9f6999 added tooltip for guardrail failure state 2025-09-18 19:11:55 -07:00
Krrish Dholakia
aa7839e4cb fix: fix test 2025-09-18 19:02:52 -07:00
=
5b080e20c4 removes HTTP exception for faulty guardrail 2025-09-18 18:57:15 -07:00
Krish Dholakia
f387803655
Merge pull request #14658 from ARajan1084/bedrock-custom-guardrail-fix
fix: check for AWS exceptions despite a 200 response
2025-09-18 18:34:32 -07:00
Krish Dholakia
3671c6a97f
Merge pull request #14690 from ARajan1084/bedrock_guardrail_logging_fix
fix: Amazon Bedrock incorrect guardrailResponse bug
2025-09-18 18:33:23 -07:00
Krish Dholakia
661a42b626
Merge pull request #14698 from BerriAI/litellm_contributor_prs_09_18_2025_p1
Litellm contributor prs 09 18 2025 p1
2025-09-18 18:32:51 -07:00
Alexsander Hamir
60800698f2
feature: generic object pool (#14702)
* add: generic object pool & tests

Introduced a reusable object pool that can be applied across the codebase.
Note: memory growth is managed via eviction settings—using a hard cap could
reduce performance, so eviction is the preferred safeguard.

* fix: simpler tests
2025-09-18 18:32:45 -07:00
Krish Dholakia
7b53edec7e
Merge pull request #14701 from ARajan1084/bedrock-guardrail-view
NEW Amazon Bedrock Guardrail Info View in Logs
2025-09-18 18:02:53 -07:00
=
7cfdc6069a upgraded build script to node 20 2025-09-18 18:01:47 -07:00
Krish Dholakia
9238e1d3bf
Merge pull request #14687 from timelfrink/fix/issue-14685-bedrock-titan-v2-encoding-format
Fix: Bedrock Titan V2 encoding_format parameter support
2025-09-18 17:54:42 -07:00
Krish Dholakia
63c26d7a4f
Merge branch 'litellm_contributor_prs_09_18_2025_p2' into fix/issue-14685-bedrock-titan-v2-encoding-format 2025-09-18 17:54:33 -07:00
Ishaan Jaffer
114d077cc9 fix: model cost map check 2025-09-18 17:52:56 -07:00
Krish Dholakia
ccb817d16c
Merge pull request #14699 from ARajan1084/bedrock-guardrail-view
NEW Amazon Bedrock Guardrail Info View in Logs
2025-09-18 17:52:19 -07:00
=
90bd1927e2 Update config.yml 2025-09-18 17:50:55 -07:00
=
61d1fabb6e upgraded vitest 2025-09-18 17:39:53 -07:00
=
4f89675267 upgraded to node 20 2025-09-18 17:38:56 -07:00
Ishaan Jaffer
c1a967992f fix: model cost map check 2025-09-18 17:37:09 -07:00
=
4f468e9563 Update bedrock_guardrails.py 2025-09-18 17:27:40 -07:00
=
12fed102ba Update bedrock_guardrails.py 2025-09-18 17:25:31 -07:00
Ishaan Jaffer
0626affa11 fix: model cost map check 2025-09-18 17:25:28 -07:00
Krish Dholakia
c7af9d1b7e
Merge pull request #14696 from ARajan1084/bedrock-guardrail-view
NEW Amazon Bedrock Guardrail Info View in Logs
2025-09-18 17:22:17 -07:00
Alexsander Hamir
59409429d4
fix: reduced __inits__ overhead in 7% (#14689)
* fix: avoid redundant __init__ calls on hot path

Previously, imports on the request hot path caused __init__ to run
excessively for every request. This change ensures initialization
happens once, reducing cpu overhead.

* fix: remove redundant __init__ import

The current implementation no longer requires an import at the top of the function.

* fix: placed on core utils for future reuse

* test: add coverage & remove inline import

A general import-checking tool across all endpoints would be a large PR.
This commit focuses on a smaller, targeted fix for the discussed case.

* added import check to CI
2025-09-18 17:18:05 -07:00
Ishaan Jaff
4c983f985a
[Feat] Add Bedrock Twelve Labs embedding provider support (#14697)
* fix: add 12 labs to bedrock embedding

* fix: get_bedrock_embedding_provider

* test: test_text_embedding

* fix: 12 labs embedding transform

* fix: refactor 12 labs transform logic

* fix: test_e2e_bedrock_embedding

* fix: test_e2e_bedrock_embedding

* feat: add bedrock twelvelabs pricing

* DOCS: docs bedrock embedding

* DOCS: 12 labs bedrock overview

* fix: bedrock embeddings 12 labs
2025-09-18 17:16:45 -07:00
=
77e4008e7b lint fix 2025-09-18 17:13:55 -07:00
=
f80660acd9 vitests for GuardrailViewer components 2025-09-18 16:57:22 -07:00
=
2bbcf5a851 Update bedrock_guardrails.py 2025-09-18 16:05:30 -07:00
katsuhiro muto
ec61a7152a
Support for is_streamed_request widh datadog (#14673) 2025-09-18 15:55:16 -07:00
=
a3f0a3c05f Update test_bedrock_guardrails.py 2025-09-18 15:51:42 -07:00