litellm/litellm
ryan-crabbe-berri 40a7fe9221 fix(budgets): make the model access group ceiling exclusive
A pool whose recorded spend has reached max_budget has nothing left to give, so
the next request is refused rather than admitted. This departs from the tag
check it otherwise mirrors and matches where keys and organizations already
draw the line.

A non-positive budget now means no budget here too, so the read-time check and
the reservation path agree on what counts as unbudgeted.
2026-08-29 15:20:10 -07:00
..
a2a_protocol refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
anthropic_interface
assistants
batch_completion
batches Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_0826 2026-08-27 10:39:56 +00:00
caching fix(caching): treat an empty cache namespace as no namespace 2026-08-26 13:48:45 -07:00
completion_extras fix(anthropic): carry tool_reference tool results through the guardrail translation round trip 2026-08-26 22:35:46 -07:00
compression
containers chore(typing): drop 1.3k basedpyright errors across 30 Any hotspot files 2026-08-16 03:56:02 +00:00
endpoints/speech/speech_to_completion_bridge fix(speech): keep proxy metadata and completion cost through the TTS completion bridge 2026-08-26 15:12:41 -07:00
evals
experimental_mcp_client feat(mcp): let a resolved OAuth token target a custom upstream header (#38456) 2026-08-27 14:32:01 -07:00
files fix(batches): accept litellm_proxy in files and batches provider type literals 2026-08-18 13:28:06 -07:00
fine_tuning
google_genai refactor(google_genai): pick the stream logging endpoint type at construction 2026-08-26 17:18:44 -07:00
images Merge origin/litellm_internal_staging into litellm_fix_36493_image_video_routes 2026-08-24 11:58:22 -07:00
integrations Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_0826 2026-08-29 04:18:02 -07:00
interactions feat(vertex_ai): add native Vertex AI Interactions API support 2026-08-25 09:55:13 -07:00
litellm_core_utils feat(budgets): enforce shared budgets on model access groups 2026-08-29 12:13:55 -07:00
llms Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_keyless_key_managed_resource_owner 2026-08-29 11:33:08 -07:00
models refactor(repositories): type prisma table access with one generic protocol 2026-08-25 12:14:17 +00:00
ocr fix(ocr): reject invalid req_format values as 400 on the SDK path 2026-08-17 15:49:18 -07:00
passthrough fix(aws): build every AWS endpoint and ARN from the region partition 2026-08-29 01:21:59 -07:00
proxy fix(budgets): make the model access group ceiling exclusive 2026-08-29 15:20:10 -07:00
proxy_auth
rag Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_0826 2026-08-29 04:18:02 -07:00
realtime_api fix(health): probe Azure GA realtime path for transcription-only models 2026-08-26 12:14:52 -07:00
repositories fix(budgets): drop the bespoke access group cache TTL and format the repository 2026-08-29 14:00:56 -07:00
rerank_api fix(together_ai): default endpoints to api.together.ai instead of api.together.xyz 2026-08-25 10:18:55 -07:00
responses feat(spend): report prompt caching savings as total and gateway-attributed (#38134) 2026-08-28 00:19:06 -07:00
router_strategy fix(spend): remove the proxy-wide autorouter savings baseline override (#38700) 2026-08-28 14:53:27 -07:00
router_utils fix(router): arm the provider-scoped fallback pin only on resource-operating handlers 2026-08-29 01:46:33 -07:00
rust_bridge refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
sandbox
search
secret_managers Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_0826 2026-08-29 04:18:02 -07:00
skills
types feat(budgets): enforce shared budgets on model access groups 2026-08-29 12:13:55 -07:00
vector_store_files
vector_stores refactor(repositories): type prisma table access with one generic protocol 2026-08-25 12:14:17 +00:00
videos refactor(videos): make video upload param keyword-only on public edit fns 2026-08-24 15:55:07 -07:00
__init__.py fix(spend): remove the proxy-wide autorouter savings baseline override (#38700) 2026-08-28 14:53:27 -07:00
_internal_context.py
_lazy_imports.py refactor(types): replace Any with real types across 178 backend files 2026-08-27 10:14:58 +00:00
_lazy_imports_registry.py fix(together_ai): route chat completions through a dedicated TogetherAIChatConfig 2026-08-25 11:44:06 -07:00
_logging.py fix(logging): stop stream-based log collectors classifying INFO logs as errors (#38476) 2026-08-27 17:42:00 -07:00
_redis.py refactor(redis): drop docstrings restating the code 2026-08-26 10:45:56 -07:00
_redis_credential_provider.py
_service_logger.py
_uuid.py
_version.py
anthropic_beta_headers_config.json
anthropic_beta_headers_manager.py
blog_posts.json
budget_manager.py
constants.py fix(budgets): drop the bespoke access group cache TTL and format the repository 2026-08-29 14:00:56 -07:00
cost.json
cost_calculator.py fix(cost_calculator): scope region_name to response-derived model names 2026-08-28 12:19:14 -07:00
exceptions.py feat(proxy): redact or drop individual batch records instead of rejecting the file (#37561) 2026-08-20 13:12:55 -07:00
main.py refactor: replace fresh getattr/setattr and test type-ignores with typed access 2026-08-29 07:59:27 +00:00
model_prices_and_context_window_backup.json Merge pull request #38593 from BerriAI/litellm_gpt5_default_reasoning_effort 2026-08-28 15:20:41 -07:00
policy_templates_backup.json
provider_endpoints_support_backup.json feat(hosted_vllm): add vLLM-Omni videos API 2026-08-24 17:10:44 -04:00
py.typed
router.py fix(router): tier-pinned reasoning_effort supersedes client effort carriers (#38698) 2026-08-28 14:53:33 -07:00
scheduler.py
setup_wizard.py
timeout.py
utils.py Merge pull request #38148 from mubashir1osmani/litellm_hosted_vllm_videos 2026-08-29 06:30:35 -07:00