litellm/litellm
Tan Nguyen cc8a3d472d fix(anthropic): refuse a marker on a tool_reference block, and drop the mutable state
The tool_result conversion rebuilds a tool_reference from its type and tool_name
alone, so a marker written on one is dropped before the request goes out. Refuse
that block type the way thinking blocks are refused.

Resolve an injection point against the messages that carry no breakpoint yet
instead of carrying a mutable set of the ones this request marked, so the walk
needs no reassignment and the caller's own markers are walked past too.
2026-10-09 02:11:05 +07:00
..
_v2 feat(cache): select Rust caching through explicit cache objects (#43601) 2026-09-29 00:01:44 +00:00
a2a_protocol refactor(llms): expose public names for private provider helpers (#45037) 2026-10-07 08:49:25 -07:00
anthropic_interface fix(proxy): send a real error event when a /v1/messages stream fails (#41826) 2026-09-25 15:36:35 -07:00
assistants refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
batch_completion
batches refactor(proxy): expose public names for private proxy helpers (#45170) 2026-10-07 18:59:27 -07:00
caching fix(caching): skip the cache past max_messages and keep tool_result text in semantic prompts (#43878) 2026-10-07 17:32:39 +00:00
chat_completions refactor(rust-bridge): unify native call inputs and Messages settings (#45126) 2026-10-07 15:05:43 -07:00
completion_extras fix(responses): map input_audio blocks in the chat-to-Responses bridge (#45224) 2026-10-07 22:25:35 -07:00
compression refactor(llms): expose public names for private provider helpers (#45037) 2026-10-07 08:49:25 -07:00
containers refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
decisions feat(decisions): add OpenAI as a Decisions provider behind a shared decisions format (#45214) 2026-10-08 04:57:41 +00:00
embeddings refactor(rust-bridge): unify native call inputs and Messages settings (#45126) 2026-10-07 15:05:43 -07:00
endpoints/speech/speech_to_completion_bridge
evals
experimental_mcp_client fix(mcp): honor scoped cache freshness (#45165) 2026-10-07 17:19:24 -07:00
files refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
fine_tuning
google_genai refactor(proxy): expose public names for private proxy helpers (#45170) 2026-10-07 18:59:27 -07:00
harness refactor(types): replace Any with proven types in 16 files (#45029) 2026-10-07 04:31:51 -07:00
images refactor: expose public hidden_params accessors (#44668) 2026-10-07 00:01:33 -07:00
integrations fix(anthropic): refuse a marker on a tool_reference block, and drop the mutable state 2026-10-09 02:11:05 +07:00
interactions refactor(llms): expose public names for private provider helpers (#45037) 2026-10-07 08:49:25 -07:00
litellm_core_utils fix(proxy): use budget reset window for projected spend alerts (#31942) 2026-10-08 12:02:40 -07:00
llms feat(decisions): add OpenAI as a Decisions provider behind a shared decisions format (#45214) 2026-10-08 04:57:41 +00:00
messages refactor(rust-bridge): unify native call inputs and Messages settings (#45126) 2026-10-07 15:05:43 -07:00
models feat(mcp): rate limit all MCP operations and add server-level rpm (#44600) 2026-10-07 16:30:52 -07:00
ocr refactor(rust-bridge): unify native call inputs and Messages settings (#45126) 2026-10-07 15:05:43 -07:00
passthrough refactor(llms): expose public names for private provider helpers (#45037) 2026-10-07 08:49:25 -07:00
proxy fix(proxy): retry lock-timed-out daily spend batches in place so the shutdown flush keeps them (#45273) 2026-10-08 12:05:47 -07:00
proxy_auth
rag perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
realtime_api fix(vertex_ai): dial the multi-region Live API host for realtime sessions (#45166) 2026-10-07 17:39:38 -07:00
repositories fix(mcp): keep worker MCP configurations consistent via a catalog revision (#42568) 2026-10-06 18:21:29 -07:00
rerank_api feat(lint): add LIT013 flagging *-ok suppressions that suppress nothing and remove the 240 stale ones (#42793) 2026-09-23 17:50:09 -07:00
responses fix(responses): keep tool_result next to tool_use on Anthropic previous_response_id continuations (#45322) 2026-10-08 09:44:11 -07:00
router_strategy fix(router): preserve native baseline identity and accounting (#44960) 2026-10-07 11:00:31 -07:00
router_utils fix(router): honor a per-request fallbacks list on a mid-stream fallback (#45227) 2026-10-07 22:25:22 -07:00
rust_bridge feat(lens): show end-user feedback on traces, stored in ClickHouse (#45171) 2026-10-07 20:14:30 -07:00
sandbox feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway (#43885) 2026-10-01 22:27:49 +00:00
search refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
secret_managers refactor(llms): expose public names for private provider helpers (#45037) 2026-10-07 08:49:25 -07:00
skills
tracing feat(lens): show end-user feedback on traces, stored in ClickHouse (#45171) 2026-10-07 20:14:30 -07:00
types feat(prometheus): expose per-project per-model rate limit allowed and used gauges (#43561) 2026-10-08 12:03:29 -05:00
vector_store_files
vector_stores refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
videos refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
__init__.py feat(decisions): add OpenAI as a Decisions provider behind a shared decisions format (#45214) 2026-10-08 04:57:41 +00:00
_internal_context.py fix(otel): nest cache spans under their operation and name service spans by purpose (#44150) 2026-10-03 09:20:27 -07:00
_lazy_imports.py refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
_lazy_imports_registry.py feat(decisions): add OpenAI as a Decisions provider behind a shared decisions format (#45214) 2026-10-08 04:57:41 +00:00
_logging.py refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
_redis.py refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
_redis_credential_provider.py refactor: expose core private helpers under public names (#44871) 2026-10-07 00:05:27 +00:00
_service_logger.py fix(otel): nest cache spans under their operation and name service spans by purpose (#44150) 2026-10-03 09:20:27 -07:00
_uuid.py
_version.py
anthropic_beta_headers_config.json fix(providers): keep thinking display updates beta (#43969) 2026-10-01 17:42:02 -07:00
anthropic_beta_headers_manager.py refactor(types): move SpanAttributes, SpecialHeaders and AllowedModelRegion out of proxy._types (#44717) 2026-10-05 21:40:13 -07:00
blog_posts.json
budget_manager.py
constants.py feat(lens): show end-user feedback on traces, stored in ClickHouse (#45171) 2026-10-07 20:14:30 -07:00
cost.json
cost_calculator.py feat(decisions): add OpenAI as a Decisions provider behind a shared decisions format (#45214) 2026-10-08 04:57:41 +00:00
exceptions.py fix(exceptions): map upstream 402 to PaymentRequiredError and cool down 402 deployments (#44879) 2026-10-06 20:35:13 -07:00
main.py fix(openai-compat): send provider attribution headers on the default SDK path (+ Perplexity) (#44291) 2026-10-07 13:21:27 -07:00
model_prices_and_context_window_backup.json fix(bedrock_mantle): take gpt-oss output limits and EOL dates from the Bedrock model cards (#45417) 2026-10-08 11:33:28 -07:00
policy_templates_backup.json fix(packaging): keep wheel paths under Windows MAX_PATH for Store Python (#43903) 2026-09-30 22:20:36 +00:00
provider_endpoints_support_backup.json feat: add Reka as an OpenAI-compatible provider (#44278) 2026-10-05 17:47:23 -07:00
py.typed
router.py fix(router): honor a per-request fallbacks list on a mid-stream fallback (#45227) 2026-10-07 22:25:22 -07:00
scheduler.py fix(scheduler): remove a request's queue entry once it stops waiting (#43061) 2026-10-07 17:34:38 -07:00
setup_wizard.py fix(model_prices): correct Claude Sonnet 5.5 capabilities and provider keys (#43587) 2026-09-28 19:12:31 +00:00
timeout.py
tool_loop.py feat(sdk): add run_tool_loop and arun_tool_loop helpers (#44381) 2026-10-03 20:10:30 -07:00
utils.py fix(logging): skip sync success callbacks for internal sub-calls, deflake RAG and Langfuse tests (#45345) 2026-10-08 04:45:21 -07:00