mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-21 00:21:49 +00:00
6bb1d77f45
* fix(support-model-specific-tpm/rpm-limits): Allows setting rate limits by tpm/rpm for models by team * fix(key_management_endpoints.py): enforce guaranteed throughput with key-level model tpm/rpm limits, when team-level tpm/rpm limits are set * test: add unit testing * feat(schema.prisma): add metadata to litellm budget table * feat(proxy/utils.py): add org limits to user api key auth allows org level tpm/rpm limiting to work * feat: add org level tpm/rpm limits + inherit org id in key from team enables org level tpm/rpm limits * feat: validated working org tpm/rpm limits * feat: support updating org level, model specific tpm/rpm limits * fix: working key validation for org level tpm/rpm limits * fix: working validation for orgs when giving tpm/rpm to teams * fix(key_management_endpoints.py): fix tpm/rpm limits on orgs * fix(key_management_endpoints.py): support limits * refactor: remove duplicate var * fix: refactor to avoid ruff errors * fix: fix typign * fix: fix linting error * fix: fix testing * fix(key_management_endpoints.py): document params |
||
|---|---|---|
| .. | ||
| auth_checks.py | ||
| auth_checks_organization.py | ||
| auth_exception_handler.py | ||
| auth_utils.py | ||
| handle_jwt.py | ||
| litellm_license.py | ||
| model_checks.py | ||
| oauth2_check.py | ||
| oauth2_proxy_hook.py | ||
| public_key.pem | ||
| rds_iam_token.py | ||
| route_checks.py | ||
| user_api_key_auth.py | ||