scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-06 02:48:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103
49353 commits 3198 branches 1436 tags 4.5 GiB
Commit graph

49353 commits

This branch
This branch
All branches
Author SHA1 Message Date
mateo-berri
ae90f1a458 fix(guardrails): type the request payload handed to the Anthropic write-back 2026-09-14 21:28:47 -07:00
mateo-berri
879fcd847f Merge remote-tracking branch 'origin/main' into litellm_sdk_exception_body_headers_do0914 2026-09-14 21:28:23 -07:00
Yujong Lee
c827344840 fix(rust-bridge): tighten _native stub for OCR input_sources and websocket construction 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 04:23:45 +00:00
Yuneng Jiang
6969bd9c54
ci: run replay harness on every admitted CircleCI pipeline 2026-09-14 21:12:16 -07:00
Yuneng Jiang
16fb44f23a
ci: run provider replay harness in CircleCI 2026-09-14 21:03:58 -07:00
Mateo Wang
94f08636c7
Merge pull request #40315 from rad-p44/fix/headroom-protect-cache-control-rows 
fix(headroom): protect cache_control-marked rows anywhere in history
 2026-09-14 21:03:16 -07:00
Yuneng Jiang
a1d216b7d7
fix(ci): test checked-out model pricing in unit jobs 2026-09-14 21:00:00 -07:00
Yujong Lee
ce7c4433ee build(rust-bridge): add typed _native stub and validate it with mypy.stubtest 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 03:54:16 +00:00
Mateo Wang
2bdafa1206
Merge branch 'main' into fix/headroom-protect-cache-control-rows 2026-09-14 20:53:07 -07:00
yuneng-jiang
9d7f2aad04
Merge branch 'main' into litellm_strict_provider_identity 2026-09-14 20:43:55 -07:00
yuneng-jiang
15bd8b0e4a
Merge pull request #40892 from BerriAI/litellm_jwt_management_callers 
test: bind management E2E callers and isolate JWT actors
 2026-09-14 20:30:52 -07:00
kerry-berri
03a4c806c4
Merge pull request #41157 from BerriAI/litellm_gemini_embedding_2_per_token_billing 
fix(cost): bill gemini-embedding-2 per token and stop double charging audio
 2026-09-14 19:49:11 -07:00
Devin AI
e668a31384 fix(health): keep realtime credential hydration immutable 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:43:48 +00:00
kerry
954dfa6ba7 test(utils): allow modality batch cost fields in cost map schema test 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:38:53 +00:00
kerry
7761d04450 test(vertex): cover malformed batch usage details 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:37:51 +00:00
Devin AI
123b76e2d8 fix(health): annotate credential resolution casts 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:34:49 +00:00
mateo-berri
8b80971586 Merge remote-tracking branch 'origin/main' into litellm_anthropic_guardrail_system_and_tool_use 2026-09-14 19:27:58 -07:00
kerry
168d0d3d99 fix(cost): drop remaining unnecessary cast in batch cost calculator 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:26:19 +00:00
mateo-berri
0a0a9509dc test(bedrock): type the session policy test helpers with the policy TypedDict 2026-09-14 19:21:23 -07:00
mateo-berri
22b377fe2a fix(proxy): log the provider usage on deferred /v1/messages calls and price cache writes without a creation rate 
With a post-call guardrail the proxy defers async success logging, and every nested wrapper on a
/v1/messages call bridged to the Responses API overwrote the stored closure, so the spend log was
built from the outermost Anthropic-shaped reply under Responses semantics and recorded the prompt
tokens without the cache hit. The first wrapper to exit now keeps the slot, which is the innermost
provider response, the same one the non-deferred path logs.

The flat cost path also billed cache-creation tokens at 0 when the model had no
cache_creation_input_token_cost. It now falls back to the input rate, and the 1h rate to the
creation rate, matching the tiered path and the custom pricing helper.
 2026-09-14 19:21:03 -07:00
Devin AI
7255a201a3 fix(health): resolve stored credentials for realtime checks 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:19:15 +00:00
kerry
a5f00b9189 fix(cost): drop unnecessary cast in batch rate lookup 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:15:22 +00:00
kerry
bf1bdb3045 fix(ci): keep cost map schema generated by the base branch generator 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:07:44 +00:00
mateo-berri
8d5d5d5824 fix(bedrock): grant rerank, retrieve, agent, and agentcore actions in the web identity session policy 2026-09-14 19:03:55 -07:00
kerry
a5fc880c90 refactor(vertex): move batch usage modality parsing under llms 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:03:32 +00:00
moe-berri
ba7857a49d fix(memory): preserve strict output formats around tool rounds 2026-09-14 19:03:03 -07:00
kerry
ca7364fb05 fix(batches): avoid strict lint violation in usage parser 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 02:00:48 +00:00
kerry
c0c5044c45 fix(batches): keep modality token details in raw vertex batch usage 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 01:57:50 +00:00
kerry
2b32f586c0 refactor(cost): extract batch modality rate lookup 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 01:51:41 +00:00
kerry
ce83fac351 fix(cost): bill batch embeddings per modality token rate 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 01:50:21 +00:00
moe-berri
6f024adfcc fix(memory): reuse shared credential redaction before persistence 2026-09-14 18:42:53 -07:00
mateo-berri
16c326537f fix(guardrails): define UnappliableRequestRewrite in the shared guardrail translation utils 
The three guardrail translation handlers imported the exception from the proxy policy engine through a function-local import, which CodeQL flagged as a cyclic import. The exception and its helper now live next to the handlers in the shared guardrail translation utils, and the tests import it from there.

The Prompt Security modify-mode helper is also restructured into early-return TypedDict displays so the LIT002 budget stays at its limit
 2026-09-14 18:39:54 -07:00
Mateo Wang
d2859e18d7
Merge pull request #40988 from BerriAI/litellm_responses_stream_error_exception_mapping 
fix(responses): route mid-stream error events through exception_type so content_policy_fallbacks fire
 2026-09-14 18:36:20 -07:00
kerry
a28ea22ec1 fix(cost): move gemini-embedding-2-preview to per-token rates 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 01:34:22 +00:00
kerry
27a486e4d3 test(cost): cover modality guards and image detection fallbacks 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 01:34:17 +00:00
Mateo Wang
1ba97665b2
Merge pull request #41046 from BerriAI/devin/1789368982-cli-strenum-py310 
fix(cli): drop enum.StrEnum so the CLI imports on Python 3.10
 2026-09-14 18:32:30 -07:00
moe-berri
f2026051a3 fix(memory): clarify account activation status 2026-09-14 18:26:18 -07:00
moe-berri
866071af6f refactor(memory): align management routes and dashboard controls 2026-09-14 18:20:55 -07:00
moe-berri
6d05a83f0e fix(memory): preserve rate-limit codes in generic stream errors 2026-09-14 18:20:54 -07:00
mateo-berri
931bdb8c0b fix(compression): protect part-level cache_control rows in compress() too 
compress() scores text-only copies of the rows, so a content-part cache_control marker was gone by the time get_protected_indices ran and the pinned row could still be stubbed. Read protection from the original rows, which are index-aligned with the normalized copies, and add a regression test that fails without the change.
 2026-09-14 18:19:51 -07:00
mateo-berri
6574d83eae Merge remote-tracking branch 'origin/main' into HEAD 
# Conflicts:
#	litellm/proxy/guardrails/guardrail_hooks/prompt_security/prompt_security.py
 2026-09-14 18:19:38 -07:00
kerry
4a8ec7b9d8 fix(cost): bill gemini-embedding-2-preview per token like the GA entries 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 01:18:50 +00:00
kerry
6a18105275 fix(vertex): only bill image rate without modality details when every input is an image 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 01:16:00 +00:00
kerry
6cbed7b4c0 fix(vertex): drop Final image_tokens redeclaration flagged by basedpyright 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 01:10:27 +00:00
moe-berri
5f61a5110b fix(memory): preserve stream errors and gateway navigation 2026-09-14 18:04:31 -07:00
moe-berri
f79a413e74 fix(cost): avoid charging audio duration and tokens twice 2026-09-14 18:04:31 -07:00
kerry
ac8e1a355c test(vertex): load local pricing in embedding billing tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 01:00:32 +00:00
Mateo Wang
dad6e9be4a
Merge branch 'main' into fix/headroom-protect-cache-control-rows 2026-09-14 17:58:17 -07:00
yucheng-berri
8481bc27f9
Merge pull request #41132 from BerriAI/litellm_bedrock_grounding_from_plain_messages 
fix(bedrock guardrails): derive contextual grounding source and query from plain messages
 2026-09-14 17:56:58 -07:00
kerry
e31c64d2e0 fix(schema): sync model price schema with cost map 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-15 00:54:58 +00:00