Krish Dholakia 552b7e4013 Add customer + model per key level multi-instance tpm/rpm limiting (#10518) ... * fix(redis_cache.py): handle multiple event loops * fix(parallel_request_limiter_v2.py): add customer tpm limiting * fix(parallel_request_limiter.py): add customer rpm limiting * fix(parallel_request_limiter_v2.py): add model per key + customer tpm/rpm limiting * fix(parallel_request_limiter_v2.py): make error more informative * fix: fix ruff error * fix: generate new poetry lock		2025-05-03 10:28:55 -07:00
..
secrets_plugins	fix secret scanner	2024-06-27 15:20:30 -07:00
aporia_ai.py	fix linting error	2025-03-12 18:42:42 -07:00
banned_keywords.py	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
blocked_user_list.py	Add key-level multi-instance tpm/rpm/max parallel request limiting (#10458)	2025-04-30 21:32:31 -07:00
google_text_moderation.py	fix linting	2025-03-12 18:44:51 -07:00
llama_guard.py	fix linting	2025-03-12 18:44:51 -07:00
llm_guard.py	Add key-level multi-instance tpm/rpm/max parallel request limiting (#10458)	2025-04-30 21:32:31 -07:00
openai_moderation.py	fix linting error	2025-03-12 18:42:42 -07:00
parallel_request_limiter_v2.py	Add customer + model per key level multi-instance tpm/rpm limiting (#10518)	2025-05-03 10:28:55 -07:00
secret_detection.py	build(pyproject.toml): add new dev dependencies - for type checking (#9631)	2025-03-29 11:02:13 -07:00
session_handler.py	Add key-level multi-instance tpm/rpm/max parallel request limiting (#10458)	2025-04-30 21:32:31 -07:00