fix(streaming): keep merged think tags balanced and split SSE lines only on CR/LF ( #48755 )
2026-10-28 17:00:29 -07:00
feat(accounting): add accounting contracts, PricingSnapshot and ledger schema (LIT-10193) ( #48862 )
2026-10-28 14:39:25 -07:00
test: move routing, caching and callback tests out of local_testing ( #45761 )
2026-10-10 09:33:09 -07:00
fix(vertex_ai): batch Claude models in Anthropic's native row shape ( #45715 )
2026-10-29 19:12:30 -07:00
chore(caching)!: remove the disk cache backend ( #48114 )
2026-10-29 18:02:31 -07:00
fix(streaming): rebuild each choice of an n>1 chat stream on its own ( #49002 )
2026-10-29 18:29:14 -07:00
test: migrate tests/llm_translation into unit, integration and e2e tiers ( #45759 )
2026-10-11 07:58:53 +00:00
refactor(typing): clear 1181 basedpyright Any errors across 431 files ( #47789 )
2026-10-24 11:31:09 -07:00
fix(vector-stores): keep proxy context out of provider vector store metadata ( #47021 )
2026-10-17 12:51:47 -07:00
feat(pass-through): add eu/jev decision API pass-through with spend tracking ( #46875 )
2026-10-29 17:52:43 -07:00
feat(vertex-ai)!: support gemini 3.1 flash tts ( #31915 )
2026-10-21 04:18:42 +00:00
refactor(router): move router callers onto the entry points and invert the proxy imports ( #48847 )
2026-10-29 17:26:33 +00:00
fix(mcp): load deprecated package aliases on demand ( #48615 )
2026-10-27 19:46:19 +00:00
feat(extraction): add /v1/extraction with Cloudflare Clairic support ( #47473 )
2026-10-20 15:51:45 -07:00
fix(fine_tuning): stop forwarding api_version to the OpenAI client ( #44995 )
2026-10-21 01:58:25 +00:00
fix(proxy): keep the litellm command light so spawned workers answer uvicorn's first health ping ( #45039 )
2026-10-29 10:25:14 -07:00
fix(google_genai): read one-object and null spellings of repeated fields in countTokens and generateContent ( #48771 )
2026-10-28 21:46:06 -07:00
fix(streaming)!: send the include_usage chunk with an empty choices array ( #47109 )
2026-10-21 02:26:05 +00:00
feat(dashscope): add image edits and text-to-speech ( #48998 )
2026-10-29 17:48:38 -07:00
test(integration): wait for every worker in Scenario.model ( #47277 )
2026-10-18 14:49:25 -07:00
fix(passthrough): log the URL model and declared provider on Gemini and Vertex failures ( #49075 )
2026-10-30 09:40:58 -07:00
fix(streaming): keep merged think tags balanced and split SSE lines only on CR/LF ( #48755 )
2026-10-28 17:00:29 -07:00
fix(exceptions): classify SGLang context window overflow ( #48837 )
2026-10-30 13:46:37 -07:00
feat(proxy): replace the pre-migration row check with a rolled-back dry run of the pending migrations ( #48961 )
2026-10-29 09:39:26 -07:00
fix(rerank): preserve token usage in spend logs ( #49308 )
2026-10-30 13:46:27 -07:00
refactor(mcp): drop the experimental label from the MCP server and client paths ( #48513 )
2026-10-27 17:47:50 +00:00
fix(proxy): allow model instances in LiteLLM_EndUserTable validation ( #41677 )
2026-10-15 10:57:26 -07:00
test(rust-bridge): relocate dispatch tests before routing changes ( #46926 )
2026-10-16 12:29:33 -07:00
fix(vllm): send the pass-through key as a bearer on both /vllm routes ( #46861 )
2026-10-30 08:57:48 -07:00
fix(ui): restore Z.AI credential fields in provider catalog ( #49325 )
2026-10-30 13:58:04 -07:00
fix(rag)!: use team provider credentials and allow viewer and JWT team access ( #45497 )
2026-10-17 23:51:48 +00:00
feat(soniox): add realtime speech-to-text on /v1/realtime ( #44822 )
2026-10-29 07:58:38 -07:00
feat(usage): show subscription-covered providers and account fees separately ( #44772 )
2026-10-30 03:58:36 -07:00
test: migrate tests/llm_translation into unit, integration and e2e tiers ( #45759 )
2026-10-11 07:58:53 +00:00
fix(responses): replay only the newest Claude thinking block on a past turn
2026-10-30 15:20:28 -07:00
feat(router): infer custom classifier tiers from model mappings ( #48987 )
2026-10-29 11:30:23 -07:00
feat(lite): offer each model group's reasoning efforts in pi, OpenCode and Codex ( #48949 )
2026-10-29 18:15:44 -07:00
fix(token_counter): price PDF pages for OpenAI and Azure models the way they bill ( #47554 )
2026-10-29 18:24:04 -07:00
fix(streaming): keep merged think tags balanced and split SSE lines only on CR/LF ( #48755 )
2026-10-28 17:00:29 -07:00
fix(search): price Tavily advanced and Linkup deep searches at their own cost map entries ( #47411 )
2026-10-19 23:32:31 -07:00
feat(secret_managers): resolve oidc/google api_key references per request ( #47703 )
2026-10-29 08:44:46 -07:00
feat(skills): add a litellm-setup agent skill ( #47731 )
2026-10-28 15:44:43 -07:00
fix(databricks): reuse base OAuth for decisions ( #48395 ) ( #48527 )
2026-10-26 20:18:16 -07:00
feat(telemetry): add AggregatingSink, fixed-bucket histograms, Report and HttpExporter ( #45487 )
2026-10-13 18:33:01 -07:00
fix(router): recover streamed context window errors before output ( #49293 )
2026-10-30 13:19:58 -07:00
fix(proxy)!: bill streamed /v1/completions without stream_options like chat ( #45366 )
2026-10-29 17:18:51 -07:00
fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported ( #46344 )
2026-10-16 00:53:52 +00:00
fix(headroom): forward tenant-scoped session affinity ( #49255 )
2026-10-30 12:32:03 -07:00
fix(exceptions)!: honor status code when mapping OpenAI invalid_request_error exceptions ( #32537 )
2026-10-29 08:05:47 -07:00
feat(vector_stores): add OpenSearch k-NN search as a vector store provider ( #47759 )
2026-10-29 08:15:05 -07:00
fix(llms): move later developer messages for models declared system-first ( #48897 )
2026-10-29 04:12:13 -07:00
test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e ( #45940 )
2026-10-11 06:24:57 -07:00
fix(anthropic)!: drop beta-gated body fields under drop_params ( #48793 )
2026-10-29 06:25:31 -07:00
fix(vertex_ai,azure_ai)!: auto-add the compaction, thinking display, and tool change betas on Claude routes ( #44747 )
2026-10-30 09:28:19 -07:00
docs(agents): keep directory rules in nested AGENTS.md and pin integration tests to CircleCI ( #46796 )
2026-10-16 14:57:49 -07:00
ci: run the integration groups on GitHub Actions ( #48985 )
2026-10-29 12:50:08 -07:00
fix(bedrock): omit system prompt from audio transcription and report its token usage ( #41565 )
2026-10-28 19:23:15 -07:00
test: move routing, caching and callback tests out of local_testing ( #45761 )
2026-10-10 09:33:09 -07:00
test: move packaging and install checks off CircleCI build_and_test ( #45757 )
2026-10-10 09:33:51 -07:00
feat(models): add Cerebras Llama 3.1 hyphenated aliases (cerebras/llama-3.1-8b, cerebras/llama-3.1-70b) ( #48157 ) ( #48158 )
2026-10-24 17:16:33 -07:00
refactor(mcp): drop the experimental label from the MCP server and client paths ( #48513 )
2026-10-27 17:47:50 +00:00
fix(proxy-extras): bound migration lock waits with SET LOCAL lock_timeout in the migration SQL ( #46329 )
2026-10-13 20:51:03 -07:00
ci: gate undocumented POST routes in the proxy OpenAPI document ( #45843 )
2026-10-10 21:51:00 +00:00
test(integration): hand every harness server a port from one per-worker block ( #46761 )
2026-10-15 16:56:40 -07:00
test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e ( #45940 )
2026-10-11 06:24:57 -07:00
test: move packaging and install checks off CircleCI build_and_test ( #45757 )
2026-10-10 09:33:51 -07:00
refactor(mcp): drop the experimental label from the MCP server and client paths ( #48513 )
2026-10-27 17:47:50 +00:00
test: migrate proxy security, schema migration and MCP legacy tests ( #45937 )
2026-10-11 16:17:24 -07:00
test: migrate tests/llm_translation into unit, integration and e2e tiers ( #45759 )
2026-10-11 07:58:53 +00:00
refactor(cost-map): remove openrouter rows, part 5 of 5 ( #45669 )
2026-10-09 22:48:55 +00:00
fix(router)!: bound fake-streamed calls by the request timeout, not stream_timeout ( #47162 )
2026-10-17 22:08:02 +00:00
test: isolate model cost maps in runtime registration tests ( #47559 )
2026-10-20 16:18:13 +00:00
fix(router): cap the default OTPM reservation and reconcile token counters after each call ( #49054 )
2026-10-29 20:32:04 -07:00
fix(cost): bill the requested model's rates when the response names an unpriced model ( #48900 )
2026-10-29 19:19:36 -07:00
fix(cost_map): mark fireworks_ai/minimax-m3 as vision and pin capabilities verified against live calls ( #43390 )
2026-10-29 00:23:11 -07:00
fix(responses)!: count input tokens the way inference sends the request ( #47363 )
2026-10-20 15:13:59 +00:00
feat(dashscope): add image edits and text-to-speech ( #48998 )
2026-10-29 17:48:38 -07:00
feat(lite): offer each model group's reasoning efforts in pi, OpenCode and Codex ( #48949 )
2026-10-29 18:15:44 -07:00
test: migrate local_testing SDK and provider tests out of build_and_test ( #45760 )
2026-10-10 23:14:25 +00:00
fix(cost-map): rolling registry audit, add elevenlabs api rates, together minimax-m3.1-flash, mistral voxtral 3 and azure_ai phi-4 dates ( #47623 )
2026-10-23 14:57:35 -07:00
fix: honor empty mock completion responses ( #48162 ) ( #48266 )
2026-10-28 00:56:45 +00:00
fix(openai): keep the upstream error body on e.response for OpenAI and Azure errors ( #49079 )
2026-10-29 23:30:02 -07:00
test: migrate local_testing SDK and provider tests out of build_and_test ( #45760 )
2026-10-10 23:14:25 +00:00
feat(gemini)!: auto-continue gemini-4-argon long decodes with continuationToken ( #46240 )
2026-10-15 22:54:23 +00:00
feat(proxy): add LITELLM_OFFLINE_MODE, one switch for the fetches LiteLLM makes on its own ( #48096 )
2026-10-23 16:54:19 -07:00
chore(hooks): drop Conventional Branches pre-push hook in favor of litellm_ prefix ( #44951 )
2026-10-20 00:35:39 +00:00
fix(streaming): keep merged think tags balanced and split SSE lines only on CR/LF ( #48755 )
2026-10-28 17:00:29 -07:00
test(integration): isolate every multi-worker integration suite by default ( #46027 )
2026-10-12 03:46:06 -07:00
feat(proxy)!: model family and access group entries in model_max_budget ( #47722 )
2026-10-28 15:40:57 -07:00
fix(health)!: openai realtime health check reports healthy with a missing or invalid api key ( #41233 )
2026-10-29 00:40:02 -07:00
fix(ci): measure PR gates from the target branch's current tip ( #49078 )
2026-10-29 18:28:16 -07:00
fix(proxy): keep the litellm command light so spawned workers answer uvicorn's first health ping ( #45039 )
2026-10-29 10:25:14 -07:00
test(unit): wait on the work itself instead of fixed sleeps ( #46261 )
2026-10-13 12:41:06 -07:00
feat(proxy)!: add suppress_startup_output to turn off startup prints ( #47708 )
2026-10-29 03:47:04 -07:00
fix(logging): warn when drop_params drops a requested reasoning level on the remaining paths ( #48933 )
2026-10-30 08:48:43 -07:00
fix(cost-map): price Mistral Large 4 at its list price now that the launch sale ended ( #48825 )
2026-10-28 18:12:55 +00:00
refactor(router): move router callers onto the entry points and invert the proxy imports ( #48847 )
2026-10-29 17:26:33 +00:00
fix(proxy)!: list every priced Vertex family under a vertex_ai/* grant ( #41959 )
2026-10-29 00:31:04 -07:00
feat(model_prices): add meta/muse-wonder-1.0 ( #46072 )
2026-10-12 19:36:52 +00:00
test: migrate local_testing SDK and provider tests out of build_and_test ( #45760 )
2026-10-10 23:14:25 +00:00
fix(ci): build base native extension for OpenAPI lint ( #49136 )
2026-10-29 16:56:44 -07:00
chore(deps): require anyio>=4.14.0 to rule out the lock-waiter deadlock ( #47378 )
2026-10-19 12:37:47 -07:00
ci: run the dashboard API types and Terraform endpoint checks on every change that can alter the spec ( #49022 )
2026-10-29 07:19:06 -07:00
refactor(router): add router entry points and keep the old members as a deprecated mixin ( #48840 )
2026-10-29 17:02:41 +00:00
test: move routing, caching and callback tests out of local_testing ( #45761 )
2026-10-10 09:33:09 -07:00
fix(register_model)!: keep bedrock geo deployments priced across price data reloads ( #41523 )
2026-10-17 19:10:04 +00:00
feat(skills): add a litellm-setup agent skill ( #47731 )
2026-10-28 15:44:43 -07:00
fix(responses): resume background response streams with stream and starting_after ( #48819 )
2026-10-29 02:31:22 -07:00
fix(responses): bill a background response once, on the first read or poll that sees it finished ( #45703 )
2026-10-15 11:00:14 -07:00
fix(streaming)!: map stream read timeouts to litellm.Timeout on chat, messages, and responses ( #47198 )
2026-10-18 13:58:34 +00:00
fix(anthropic)!: send /v1/messages PDF documents to OpenAI-shaped providers as file parts ( #47166 )
2026-10-29 08:06:12 -07:00
fix(router): keep the prompt caching affinity pin alive as long as the prefix's cache_control ttl ( #46084 )
2026-10-14 21:10:09 -07:00
fix(images): honor max_retries and prevent Router retry amplification ( #48705 )
2026-10-28 10:46:47 -07:00
fix(proxy): unset DB environment variables removed from the row on every worker by row revision ( #46709 )
2026-10-17 03:51:05 +00:00
fix(logging): mark mirrored silent_model calls with is_silent_experiment in spend logs ( #48888 )
2026-10-29 05:12:50 -07:00
fix(router): let affinity pins yield to deployments that already failed this request ( #32309 )
2026-10-28 03:24:26 -07:00
feat(scaledown): add native text provider support ( #44168 )
2026-10-10 14:01:17 -07:00
refactor(rust-bridge): require the native extension ( #48852 )
2026-10-28 13:16:56 -07:00
refactor(lens): connect LiteLLM to the independent Lens service ( #45529 )
2026-10-09 16:17:05 -07:00
fix(ci): measure PR gates from the target branch's current tip ( #49078 )
2026-10-29 18:28:16 -07:00
fix(ci): flag any schema.prisma change inside model LiteLLM_SpendLogs in the spend logs guard (LIT-10240) ( #48905 )
2026-10-28 15:52:15 -07:00
fix(anthropic)!: send /v1/messages PDF documents to OpenAI-shaped providers as file parts ( #47166 )
2026-10-29 08:06:12 -07:00
fix(prompt_templates): do not mutate messages in-place in function_call_prompt ( #41676 )
2026-10-15 14:37:11 -07:00
refactor(cost-map): drop the legacy max_tokens field in favor of max_input_tokens and max_output_tokens ( #48471 )
2026-10-26 17:03:05 -07:00
fix(responses): replay the original Responses item order, phase, and boundaries on the next chat turn ( #48912 )
2026-10-29 00:56:02 -07:00
fix(cost): price typesafe/jev-1.14.0 ( #46594 )
2026-10-14 20:27:35 -07:00
fix(openrouter)!: list OpenRouter's live catalog for openrouter/* when check_provider_endpoint is on ( #48820 )
2026-10-30 12:19:51 -07:00
fix(bedrock): price claude_platform calls from their own cost map rows ( #48150 )
2026-10-24 13:54:18 -07:00
fix(openai): warn when the GPT-5 reasoning effort gate drops a level under drop_params ( #47761 )
2026-10-29 04:46:29 -07:00
fix: support Python 3.15 ( #48359 )
2026-10-26 16:00:11 +00:00
test: migrate tests/llm_translation into unit, integration and e2e tiers ( #45759 )
2026-10-11 07:58:53 +00:00
refactor(router): move router callers onto the entry points and invert the proxy imports ( #48847 )
2026-10-29 17:26:33 +00:00
fix(router)!: stop a chat-mode Mantle deployment from rewriting the shared Responses routing row ( #46263 )
2026-10-17 21:39:14 +00:00
