scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-29 06:33:28 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 200
litellm/litellm
History
Kerry Lu 75beecc806 fix(proxy): price a 499 spend row only for the proxy's own disconnect, and never after the call already completed (#47652) 
* fix(proxy): price a 499 spend row only for the proxy's own disconnect, and never after the call already completed

* fix(proxy): gate the zero-cost 499 row on the success log being enqueued, not merely claimed

---------

Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>

Backport of #47652 to stable/1.106.x
Cherry-picked from ffb7133d32 (main)
2026-10-21 00:26:25 +00:00
..
_v2 feat(cache): select Rust caching through explicit cache objects (#43601) 2026-09-29 00:01:44 +00:00
a2a_protocol refactor(llms): expose public names for private provider helpers (#45037) 2026-10-07 08:49:25 -07:00
anthropic_interface fix(proxy): send a real error event when a /v1/messages stream fails (#41826) 2026-09-25 15:36:35 -07:00
assistants refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
batch_completion
batches fix(batches): apply the Vertex regional endpoint uplift to batch cost (#47466) 2026-10-21 00:07:12 +00:00
caching fix(caching): backport #45784 and #46488 to rc/1.106.0 (#47006) 2026-10-16 15:34:17 -07:00
chat_completions refactor(python-bridge): ship a signature base and read the resolved call (#45450) 2026-10-08 17:20:29 -07:00
completion_extras fix(responses): fold bridged Responses output into one chat choice (#46099) 2026-10-19 22:27:55 -07:00
compression refactor(llms): expose public names for private provider helpers (#45037) 2026-10-07 08:49:25 -07:00
containers refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
decisions fix(decisions): log non-UTF-8 bytes as base64 so the request reaches validation and gets a 400 (#47564) 2026-10-21 00:07:12 +00:00
embeddings refactor(python-bridge): ship a signature base and read the resolved call (#45450) 2026-10-08 17:20:29 -07:00
endpoints/speech/speech_to_completion_bridge refactor(speech): freeze httpx response header dicts (LIT002) 2026-08-31 21:12:53 -07:00
evals
experimental_mcp_client feat(mcp): translate input requests and bind continuations (#45464) 2026-10-08 20:10:10 -07:00
files refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
fine_tuning refactor(typing): replace Any with proven types in 89 more backend files 2026-09-02 23:08:42 +00:00
google_genai refactor(proxy): expose public names for private proxy helpers (#45170) 2026-10-07 18:59:27 -07:00
harness refactor(types): replace Any with proven types in 16 files (#45029) 2026-10-07 04:31:51 -07:00
images refactor: expose public hidden_params accessors (#44668) 2026-10-07 00:01:33 -07:00
integrations Merge pull request #47389 from BerriAI/litellm_backport_count_tokens_stable_1_104_x 2026-10-19 23:06:47 -07:00
interactions refactor(llms): expose public names for private provider helpers (#45037) 2026-10-07 08:49:25 -07:00
litellm_core_utils fix(proxy): price a 499 spend row only for the proxy's own disconnect, and never after the call already completed (#47652) 2026-10-21 00:26:25 +00:00
llms fix(proxy): bill partial Responses API streams when the client disconnects (#47611) 2026-10-21 00:26:25 +00:00
messages refactor(python-bridge): ship a signature base and read the resolved call (#45450) 2026-10-08 17:20:29 -07:00
models feat(credentials): add display_name and make credential_name immutable on PATCH (#43148) 2026-10-08 23:49:56 -07:00
ocr refactor(python-bridge): ship a signature base and read the resolved call (#45450) 2026-10-08 17:20:29 -07:00
passthrough feat(router): let a deployment set a timeout per service_tier (#47406) 2026-10-20 23:54:26 +00:00
proxy fix(proxy): price a 499 spend row only for the proxy's own disconnect, and never after the call already completed (#47652) 2026-10-21 00:26:25 +00:00
proxy_auth refactor(types): replace Any with real types across 29 more backend files 2026-09-08 10:14:07 +00:00
rag perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
realtime_api fix(vertex_ai): dial the multi-region Live API host for realtime sessions (#45166) 2026-10-07 17:39:38 -07:00
repositories feat(credentials): add display_name and make credential_name immutable on PATCH (#43148) 2026-10-08 23:49:56 -07:00
rerank_api feat(lint): add LIT013 flagging *-ok suppressions that suppress nothing and remove the 240 stale ones (#42793) 2026-09-23 17:50:09 -07:00
responses fix(proxy): bill partial Responses API streams when the client disconnects (#47611) 2026-10-21 00:26:25 +00:00
router_strategy feat(ui): backport decision auto-router setup to 1.106 (#45916) 2026-10-10 22:35:10 -07:00
router_utils feat(ui): backport decision auto-router setup to 1.106 (#45916) 2026-10-10 22:35:10 -07:00
rust_bridge refactor(sdk): separate core AWS and tokenizer dependencies (#44447) 2026-10-08 19:07:57 -07:00
sandbox feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway (#43885) 2026-10-01 22:27:49 +00:00
search refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
secret_managers refactor(sdk): separate core AWS and tokenizer dependencies (#44447) 2026-10-08 19:07:57 -07:00
skills feat(skills): semantic search over the LiteLLM-hosted skill registry (#39401) 2026-09-07 12:28:38 -07:00
systemone fix(decisions): log every request field the caller sent on /v1/systemone and /v1/decisions (#47183) 2026-10-20 23:53:37 +00:00
tracing feat(lens): show end-user feedback on traces, stored in ClickHouse (#45171) 2026-10-07 20:14:30 -07:00
types feat(proxy): opt-in free-tier allowance for Google Search grounding spend (#47494) 2026-10-21 00:26:25 +00:00
vector_store_files refactor(types): replace Any with real types across 54 more backend files 2026-09-08 12:41:07 +00:00
vector_stores fix(vector-stores): keep proxy context out of provider vector store metadata (#47021) 2026-10-19 22:43:02 -07:00
videos refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
__init__.py feat(proxy): opt-in free-tier allowance for Google Search grounding spend (#47494) 2026-10-21 00:26:25 +00:00
_internal_context.py fix(otel): nest cache spans under their operation and name service spans by purpose (#44150) 2026-10-03 09:20:27 -07:00
_lazy_imports.py refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
_lazy_imports_registry.py feat(typesafe): support Jev 1.14 images, box questions, and long-context headers (#46596) 2026-10-15 06:32:44 +00:00
_logging.py refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
_redis.py refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
_redis_credential_provider.py refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
_service_logger.py fix(otel): nest cache spans under their operation and name service spans by purpose (#44150) 2026-10-03 09:20:27 -07:00
_uuid.py
_version.py feat(sdk): build core from an independent packaging manifest (#44340) 2026-10-08 18:40:14 -07:00
anthropic_beta_headers_config.json fix(vertex_ai): forward the inline-tools-2026-09-15 beta to Vertex and Anthropic (#45297) 2026-10-08 12:27:52 -07:00
anthropic_beta_headers_manager.py refactor(types): move SpanAttributes, SpecialHeaders and AllowedModelRegion out of proxy._types (#44717) 2026-10-05 21:40:13 -07:00
blog_posts.json
budget_manager.py
constants.py feat(proxy): opt-in free-tier allowance for Google Search grounding spend (#47494) 2026-10-21 00:26:25 +00:00
cost.json
cost_calculator.py fix(batches): apply the Vertex regional endpoint uplift to batch cost (#47466) 2026-10-21 00:07:12 +00:00
exceptions.py fix(exceptions): map upstream 402 to PaymentRequiredError and cool down 402 deployments (#44879) 2026-10-06 20:35:13 -07:00
main.py feat(decisions): accept decisions as a model mode alongside evaluation (#45474) 2026-10-15 06:21:36 +00:00
model_prices_and_context_window_backup.json feat(proxy): opt-in free-tier allowance for Google Search grounding spend (#47494) 2026-10-21 00:26:25 +00:00
policy_templates_backup.json fix(packaging): keep wheel paths under Windows MAX_PATH for Store Python (#43903) 2026-09-30 22:20:36 +00:00
provider_endpoints_support_backup.json feat(voyage): rebrand to VoyageAI by MongoDB and route MongoDB keys to ai.mongodb.com (#41812) 2026-10-08 13:12:47 -07:00
py.typed
router.py fix(proxy): bill partial Responses API streams when the client disconnects (#47611) 2026-10-21 00:26:25 +00:00
scheduler.py fix(scheduler): remove a request's queue entry once it stops waiting (#43061) 2026-10-07 17:34:38 -07:00
setup_wizard.py fix(model_prices): correct Claude Sonnet 5.5 capabilities and provider keys (#43587) 2026-09-28 19:12:31 +00:00
timeout.py
tool_loop.py feat(sdk): add run_tool_loop and arun_tool_loop helpers (#44381) 2026-10-03 20:10:30 -07:00
utils.py fix(proxy): price a 499 spend row only for the proxy's own disconnect, and never after the call already completed (#47652) 2026-10-21 00:26:25 +00:00