litellm/litellm
Taranum Wasu 8bddeefe31 fix(proxy): resolve mainline drift in end-user budget enforcement
Preserve the relocated shared fallback helper and upstream script removal.
Retain opt-in master-key budget enforcement and verified JWT customer handling.

63 focused auth/budget/fallback regression cases pass on current main.
2026-10-06 23:49:01 +05:30
..
_v2 feat(cache): select Rust caching through explicit cache objects (#43601) 2026-09-29 00:01:44 +00:00
a2a_protocol refactor(types): replace Any with proven types in 137 files (#44478) 2026-10-05 11:01:45 -07:00
anthropic_interface fix(proxy): send a real error event when a /v1/messages stream fails (#41826) 2026-09-25 15:36:35 -07:00
assistants refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
batch_completion
batches feat(anthropic): workload identity federation and pluggable identity sources (#44448) 2026-10-03 17:08:30 -07:00
caching refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
chat_completions refactor(rust): remove delivery routing abstraction (#43514) 2026-09-28 03:31:22 +00:00
completion_extras fix(responses): honor request cache controls on chat completions bridged to the Responses API (#44676) 2026-10-05 17:52:44 -07:00
compression refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
containers refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
decisions refactor: clean up fresh tech debt from 2026-10-03 (#44484) 2026-10-04 01:31:23 -07:00
embeddings feat(embeddings): add native dispatch foundation (#42799) 2026-09-23 21:11:09 +00:00
endpoints/speech/speech_to_completion_bridge
evals
experimental_mcp_client fix(mcp): preserve upstream tool schemas and parameter headers (#44425) 2026-10-03 15:00:43 -07:00
files refactor(types): replace Any with proven types in 137 files (#44478) 2026-10-05 11:01:45 -07:00
fine_tuning
google_genai refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
harness refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
images fix(vertex_ai): apply regional endpoint uplift on image generation cost path (#44679) 2026-10-05 20:02:22 -07:00
integrations refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
interactions refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
litellm_core_utils fix(security): remove the publicly known master key from the repo (#44718) 2026-10-06 10:55:24 -07:00
llms fix(sap): correctly handle cache_control (#39122) 2026-10-06 08:54:06 -07:00
messages refactor(rust): remove delivery routing abstraction (#43514) 2026-09-28 03:31:22 +00:00
models perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
ocr refactor(ocr): remove the Python OCR execution path and require the Rust route (#43081) 2026-09-24 18:18:50 -07:00
passthrough fix(responses): fall back on pre-output stream drops, fail truncated streams, honor request_timeout (#43133) 2026-09-25 14:32:41 -07:00
proxy fix(proxy): resolve mainline drift in end-user budget enforcement 2026-10-06 23:49:01 +05:30
proxy_auth refactor(types): replace Any with real types across 29 more backend files 2026-09-08 10:14:07 +00:00
rag perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
realtime_api refactor(types): replace Any with proven types in 13 files (#42937) 2026-09-24 09:02:02 -07:00
repositories refactor(types): replace Any with proven types in 137 files (#44478) 2026-10-05 11:01:45 -07:00
rerank_api feat(lint): add LIT013 flagging *-ok suppressions that suppress nothing and remove the 240 stale ones (#42793) 2026-09-23 17:50:09 -07:00
responses refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
router_strategy refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
router_utils fix(router): retry a /v1/messages stream the provider drops before the first content chunk (#44276) 2026-10-05 22:53:39 +00:00
rust_bridge perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
sandbox feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway (#43885) 2026-10-01 22:27:49 +00:00
search refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
secret_managers perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
skills feat(skills): semantic search over the LiteLLM-hosted skill registry (#39401) 2026-09-07 12:28:38 -07:00
tracing fix(lens): reconstruct native coding agent conversations (#44711) 2026-10-05 17:51:05 -07:00
types perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
vector_store_files refactor(types): replace Any with real types across 54 more backend files 2026-09-08 12:41:07 +00:00
vector_stores refactor(types): replace Any with proven types in 137 files (#44478) 2026-10-05 11:01:45 -07:00
videos refactor(types): replace Any with proven types in 157 files (#44798) 2026-10-06 15:31:54 +00:00
__init__.py fix(proxy): resolve mainline drift in end-user budget enforcement 2026-10-06 23:49:01 +05:30
_internal_context.py fix(otel): nest cache spans under their operation and name service spans by purpose (#44150) 2026-10-03 09:20:27 -07:00
_lazy_imports.py perf(proxy): stop prompt-cache eligibility from tokenizing the whole conversation (#44221) 2026-10-03 09:20:28 -07:00
_lazy_imports_registry.py feat(scaleway): add rerank support (#44160) 2026-10-02 21:20:05 -07:00
_logging.py chore(lint): remove the LIT002 mutable-construction rule (#43971) 2026-10-01 12:24:02 -07:00
_redis.py chore(lint): remove the LIT002 mutable-construction rule (#43971) 2026-10-01 12:24:02 -07:00
_redis_credential_provider.py fix(redis): accept every truthy flag and sign serverless ElastiCache caches 2026-09-10 10:13:03 -04:00
_service_logger.py fix(otel): nest cache spans under their operation and name service spans by purpose (#44150) 2026-10-03 09:20:27 -07:00
_uuid.py
_version.py
anthropic_beta_headers_config.json fix(providers): keep thinking display updates beta (#43969) 2026-10-01 17:42:02 -07:00
anthropic_beta_headers_manager.py refactor(types): move SpanAttributes, SpecialHeaders and AllowedModelRegion out of proxy._types (#44717) 2026-10-05 21:40:13 -07:00
blog_posts.json
budget_manager.py
constants.py perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
cost.json
cost_calculator.py fix(azure): add model router flat fee to azure provider cost tracking (#44876) 2026-10-06 10:47:26 -07:00
exceptions.py fix(spend): return 400 from /spend/calculate for a model with no pricing row (#42497) 2026-09-22 15:44:00 -07:00
main.py perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
model_prices_and_context_window_backup.json chore(prices): add gemini/gemini-nano-banana-2.1 from the Gemini pricing page (#44868) 2026-10-06 18:06:35 +00:00
policy_templates_backup.json fix(packaging): keep wheel paths under Windows MAX_PATH for Store Python (#43903) 2026-09-30 22:20:36 +00:00
provider_endpoints_support_backup.json feat: add Reka as an OpenAI-compatible provider (#44278) 2026-10-05 17:47:23 -07:00
py.typed
router.py refactor(types): replace Any with proven types in 6 files (#44491) 2026-10-06 09:53:43 +00:00
scheduler.py perf(types): defer pydantic schema builds via shared LiteLLMBaseModel (#44720) 2026-10-05 22:10:08 -07:00
setup_wizard.py fix(model_prices): correct Claude Sonnet 5.5 capabilities and provider keys (#43587) 2026-09-28 19:12:31 +00:00
timeout.py
tool_loop.py feat(sdk): add run_tool_loop and arun_tool_loop helpers (#44381) 2026-10-03 20:10:30 -07:00
utils.py fix(responses): stop SDK retries nesting under router retries, and unbreak CircleCI integration tests (#44791) 2026-10-06 15:57:33 +00:00