yassin 438d46cb50 feat(proxy): add tpd_limit (tokens per day) for batch submissions ... Adds a nullable tpd_limit column and field to keys, teams, budgets and end users. The batch submission limiter swaps the per-minute RPM/TPM descriptor of any scope that has a tpd_limit for a token-only 24h descriptor, so batch traffic is budgeted per day while online traffic keeps the existing per-minute limits. The Admin UI exposes the field on key, team and budget create/edit forms Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-09-13 10:06:07 +00:00
..
a2a_protocol	fix(bedrock): sign on a dedicated executor instead of the shared default one	2026-09-09 18:52:00 -07:00
anthropic_interface	fix(anthropic_endpoints): return Anthropic type:error envelope for /v1/messages errors	2026-08-31 16:23:36 -07:00
assistants	refactor(typing): replace Any with proven types in 89 more backend files	2026-09-02 23:08:42 +00:00
batch_completion
batches	Merge pull request #39626 from BerriAI/litellm_batch_ui_logs	2026-09-08 15:19:25 -07:00
caching	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_redis_pool_timeout_counts_as_timeout	2026-09-12 15:26:08 -07:00
completion_extras	fix(router): classify encrypted delegated tasks with native Responses	2026-09-10 12:32:09 -07:00
compression	refactor(typing): replace Any with proven types in 89 more backend files	2026-09-02 23:08:42 +00:00
containers	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_decrease_anys_opus5_r4	2026-09-02 23:32:10 +00:00
endpoints/speech/speech_to_completion_bridge	refactor(speech): freeze httpx response header dicts (LIT002)	2026-08-31 21:12:53 -07:00
evals
experimental_mcp_client	fix(mcp): bind discovery caching to credentials and active callers	2026-09-11 14:49:00 -07:00
files	merge: bring litellm_internal_staging into the Bedrock files delete and list fix	2026-09-09 19:27:40 -07:00
fine_tuning	refactor(typing): replace Any with proven types in 89 more backend files	2026-09-02 23:08:42 +00:00
google_genai	refactor(types): replace Any with precise types across 73 modules	2026-09-01 11:05:02 +00:00
images	refactor(typing): replace Any with proven types in 89 more backend files	2026-09-02 23:08:42 +00:00
integrations	Merge pull request #40772 from BerriAI/litellm_lit6982_bucket_config_includes	2026-09-12 15:21:56 -07:00
interactions	refactor(typing): replace Any with proven types in 42 more backend files	2026-09-02 15:35:01 +00:00
litellm_core_utils	Merge pull request #39846 from BerriAI/litellm_bedrock_mantle_govcloud_cost_row	2026-09-12 21:13:58 -07:00
llms	Merge pull request #39846 from BerriAI/litellm_bedrock_mantle_govcloud_cost_row	2026-09-12 21:13:58 -07:00
models	feat(proxy): add tpd_limit (tokens per day) for batch submissions	2026-09-13 10:06:07 +00:00
ocr	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_ocr_custom_pricing	2026-09-12 15:42:59 -07:00
passthrough	fix(passthrough): parse Bedrock stream spend incrementally instead of buffering the whole response (#40724)	2026-09-11 09:53:37 -07:00
proxy	feat(proxy): add tpd_limit (tokens per day) for batch submissions	2026-09-13 10:06:07 +00:00
proxy_auth
rag	chore: merge origin/litellm_internal_staging into litellm_decrease_anys_opus5_r4	2026-09-04 18:59:35 -07:00
realtime_api	refactor(realtime): move Meta Muse Voice onto BaseRealtimeConfig	2026-09-11 20:12:15 -07:00
repositories	feat(auto-router): show routed model and savings in Claude Code and Codex (#40330)	2026-09-11 12:52:42 -07:00
rerank_api	fix(rerank): adopt declared authenticating providers in arerank instead of resolving them	2026-09-01 14:47:59 -07:00
responses	fix(responses): carry the reasoning summary as an alias, not inside reasoning_effort	2026-09-12 17:49:30 -07:00
router_strategy	fix(router): fall back from unhealthy auto-router tier (#40757)	2026-09-11 11:51:55 -07:00
router_utils	feat(proxy): expose complexity routing headers (#40792)	2026-09-11 17:14:40 -07:00
rust_bridge	refactor(ocr): complete native lifecycle and preserve Azure auth (#40734)	2026-09-12 11:56:49 -07:00
sandbox
search	fix(search): forward search-tool params through the router, complete Parallel AI v1 param mapping (#37883)	2026-09-01 21:46:46 -07:00
secret_managers	feat(secret_managers): support customer-managed KMS key for virtual keys stored in AWS Secrets Manager (#40475)	2026-09-11 09:54:08 -07:00
skills	feat(skills): semantic search over the LiteLLM-hosted skill registry (#39401)	2026-09-07 12:28:38 -07:00
types	fix(router): preserve Azure Entra ID params in reusable credentials (#40889)	2026-09-12 21:13:45 -07:00
vector_store_files	refactor(typing): replace Any with proven types in 42 more backend files	2026-09-02 15:35:01 +00:00
vector_stores	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_python_version_ci	2026-09-03 00:16:19 -07:00
videos
__init__.py	Merge pull request #40770 from BerriAI/litellm_lit6996_agent_skills_wellknown	2026-09-12 15:20:20 -07:00
_internal_context.py	fix(proxy): price one cost estimate at one moment	2026-09-07 18:38:12 -07:00
_lazy_imports.py	fix(lazy_imports): type import_map as Mapping to stay under the LIT001 budget	2026-09-05 16:12:45 -07:00
_lazy_imports_registry.py	Revert "perf: lazy-load SDK symbols so import litellm stays under 60 MB RSS (…"	2026-09-05 16:07:09 -07:00
_logging.py	fix(proxy): stop leaking internal exception details to clients (#39380)	2026-09-02 17:32:00 -07:00
_redis.py	fix(redis): accept every truthy flag and sign serverless ElastiCache caches	2026-09-10 10:13:03 -04:00
_redis_credential_provider.py	fix(redis): accept every truthy flag and sign serverless ElastiCache caches	2026-09-10 10:13:03 -04:00
_service_logger.py	chore: merge origin/litellm_internal_staging into litellm_decrease_anys_opus5_r4	2026-09-04 18:59:35 -07:00
_uuid.py
_version.py
anthropic_beta_headers_config.json
anthropic_beta_headers_manager.py
blog_posts.json
budget_manager.py
constants.py	feat(proxy): add tpd_limit (tokens per day) for batch submissions	2026-09-13 10:06:07 +00:00
cost.json
cost_calculator.py	Merge pull request #39846 from BerriAI/litellm_bedrock_mantle_govcloud_cost_row	2026-09-12 21:13:58 -07:00
exceptions.py	Merge pull request #39516 from BerriAI/litellm_vector_store_surface_retrieval_failure	2026-09-11 11:46:42 -07:00
main.py	fix(streaming): keep admitted mock streams alive with empty stream_options and honor zero prompt counts (#40650)	2026-09-10 18:37:39 -07:00
model_prices_and_context_window_backup.json	Merge pull request #35918 from Lee-Si-Yoon/feat/friendli-model-metadata-sync	2026-09-12 21:13:52 -07:00
policy_templates_backup.json
provider_endpoints_support_backup.json	fix(ocr): send each provider a health-check document it accepts	2026-09-04 22:52:12 -07:00
py.typed
router.py	feat(proxy): expose complexity routing headers (#40792)	2026-09-11 17:14:40 -07:00
scheduler.py
setup_wizard.py	feat(models): add Claude Fable 5.1 across Anthropic, Bedrock, Vertex AI, and Azure AI	2026-09-01 18:07:06 +00:00
timeout.py
utils.py	Merge pull request #40929 from BerriAI/litellm_fireworks_short_key_lookup	2026-09-12 20:49:44 -07:00