litellm/litellm/types
Harshit Jain 6d86808eaf feat: enforce model-level TPM/RPM limits (enforce_model_rate_limits) … (#19230)
* feat: enforce model-level TPM/RPM limits (enforce_model_rate_limits) flag

* fix lint errors
2026-02-02 18:18:46 +05:30
..
containers [Feat] Containers API - add new container API file management + UI Interface (#17745) 2025-12-09 17:33:26 -08:00
google_genai Fix Google GenAI types import to handle missing google.genai module 2025-10-01 01:56:52 +08:00
images fix: fix import errors 2025-09-14 09:32:21 -07:00
integrations Merge branch 'main' into litellm_oss_staging_01_27_2026 2026-01-27 17:11:15 +05:30
interactions [Feat] New Endpoint - Google Interactions API - added on litellm SDK (#18079) 2025-12-17 02:18:51 +04:00
litellm_core_utils include server_tool_use in streaming usage (#16826) 2025-11-25 14:50:17 -08:00
llms feat: enhance Cohere embedding support with additional parameters and model version 2026-02-01 18:04:08 +02:00
management_endpoints Add fallback endpoints support 2026-01-16 10:51:33 +05:30
mcp_server fix: periodically refresh MCP registry across instances via scheduler job 2026-01-09 17:12:17 +09:00
passthrough_endpoints Revert "Add streamGenerateContent cost tracking in passthrough (#15199)" (#15202) 2025-10-04 14:37:02 -07:00
prompts Prompt Management - new API for integrating providers (#17829) 2025-12-11 15:43:40 -08:00
proxy bulk update keys endpoint 2026-01-27 13:58:32 -08:00
responses Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) 2025-12-15 18:19:52 +05:30
secret_managers [Feat] Adds IAM role assumption support for AWS Secret Manager (#16887) 2025-11-20 12:38:48 -08:00
videos Fix error about encoding video id for azure 2025-12-09 16:36:11 +05:30
adapter.py feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
agents.py [Feat] A2a Gateway - allow using bedrock agentcore, langgraph agents with A2a Gateway (#17786) 2025-12-10 13:08:43 -08:00
caching.py fix mypy error in caching.py 2026-01-15 08:35:08 +05:30
completion.py fix: correct CompletionRequest messages type to match OpenAI API spec (#12980) 2025-07-28 16:47:20 -07:00
embedding.py Removed config dict type definition 2024-05-17 10:39:00 +08:00
files.py [Feat] Manus FILES API - Add File upload, get, delete, list (#18904) 2026-01-10 13:27:54 -08:00
fine_tuning.py (feat) POST /fine_tuning/jobs support passing vertex specific hyper params (#7490) 2025-01-01 07:44:48 -08:00
guardrails.py fix: guardrails issues streaming-response regex (#19901) 2026-01-27 17:36:18 -08:00
mcp.py MCP Hub - publish/discover MCP Servers within a company (#16857) 2025-11-19 19:06:21 -08:00
policy_engine.py [Feat] New LiteLLM Policy engine - create policies to manage guardrails, conditions - permissions per Key, Team (#19612) 2026-01-22 19:49:53 -08:00
rag.py [Feat] RAG API - Add support for using s3 Vectors as Vector Store Provider for /rag/ingest (#19888) 2026-01-27 14:45:26 -08:00
realtime.py fix: fix import errors 2025-09-14 09:32:21 -07:00
rerank.py build(pyproject.toml): add new dev dependencies - for type checking (#9631) 2025-03-29 11:02:13 -07:00
router.py feat: enforce model-level TPM/RPM limits (enforce_model_rate_limits) … (#19230) 2026-02-02 18:18:46 +05:30
scheduler.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
search.py fix linting 2025-10-23 18:05:30 -07:00
services.py [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
tag_management.py [Feat] Tag Management - Add support for setting tag based budgets (#15433) 2025-10-10 19:24:50 -07:00
utils.py refactor(image-gen): move thought_signature to provider_specific_fields 2026-02-02 18:12:41 +05:30
vector_store_files.py Vector store files Stable Release (#16643) 2025-11-15 13:00:33 -08:00
vector_stores.py [Feat] LiteLLM Vector Stores - Add permission management for users, teams (#19972) 2026-01-28 18:55:40 -08:00