mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-26 01:12:21 +00:00
c5e2c6cc63
four things from the bot review: 1. validate_models_exist bailed early with (False, all_names) when llm_router was None - never even checked known_access_groups. db-only setups couldn't create a group of groups at all. now we check known_groups even without a router. 2. get_group_memberships_from_db only caught AttributeError + TypeError, so a transient DB error would 500 every /v1/models call. broadened to Exception - the fallback now actually catches what the docstring says it does. 3. delete_group_membership_edges does WHERE parent OR child but only parent had an index. added @@index([child_group]) + a tiny migration. 4. get_group_memberships_from_db was being called on every model-listing request. added a 60s in-process TTL cache via get_cached_group_memberships, with explicit invalidation on every membership write. same shape as the existing llm_router.get_model_access_groups() cache. 9 tests for the above. refs #28032 |
||
|---|---|---|
| .. | ||
| dist | ||
| litellm_proxy_extras | ||
| tests | ||
| build_and_publish.md | ||
| LICENSE | ||
| migration_runbook.md | ||
| pyproject.toml | ||
| README.md | ||
Additional files for the proxy. Reduces the size of the main litellm package.
Currently, only stores the migration.sql files for litellm-proxy.
To install, run:
uv add litellm-proxy-extras
OR
uv tool install 'litellm[proxy]' # installs litellm-proxy-extras and other proxy dependencies
To use the migrations, run:
litellm --use_prisma_migrate