mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-14 09:03:16 +00:00
d30b2b9b26
* feat(proxy): enforce customer org, team and member budgets and limits on the request path Resolve x-litellm-customer-member-id at auth, walk member -> team -> org, enforce max_budget, allowed_models, tpm/rpm and per-model limits at every level in the v3 limiter, honor the hierarchy allowlists in alternate-model steering, and settle spend to the member, team and org rows. Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(auth): customer hierarchy survives virtual key auth without a legacy end user Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * feat(auth): keys pinned to a customer organization may only act for that organization's members Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * style(proxy): keep the customer hierarchy spend maps within the line limit Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(auth): check the key's customer org scope after the key is resolved Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): declare the hierarchy cache key family and keep type counts flat Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(auth): resolve the customer hierarchy in the shared authorization gate Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): drop a member's cached hierarchy through the declared cache target Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * style(auth): keep the hierarchy reset within the line limit Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(auth): type the requested models as a sequence Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * feat(spend): add daily customer usage and budget resets (#51493) * feat(spend): add daily customer usage and budget resets * chore(spend): document customer reset query bounds * fix(spend): chart customer queue metrics and update recovery test * fix(proxy): read stamped customer ids from either metadata bucket, alias-aware model check, broadcast member evictions Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * Revert "feat(spend): add daily customer usage and budget resets (#51493)" This reverts commit |
||
|---|---|---|
| .. | ||
| image | ||
| migrations | ||
| test_alerts.py | ||
| test_chunked_in_lists.py | ||
| test_cleanup_transactions.py | ||
| test_global_spend_refresh_writer.py | ||
| test_harness_lifecycle.py | ||
| test_managed_file_flat_ids_index.py | ||
| test_migration_entrypoint.py | ||
| test_partition_transactions.py | ||
| test_performance_alerts.py | ||
| test_prisma_engine_port.py | ||
| test_prisma_migration_lock.py | ||
| test_proxy_boot_without_general_settings.py | ||
| test_proxy_database_lifespan.py | ||
| test_reader_writer_regeneration.py | ||
| test_request_log_indexes_at_boot.py | ||
| test_roi_observed.py | ||
| test_roi_sync_store.py | ||
| test_scheduled_job_runs.py | ||
| test_skill_publication.py | ||
| test_skill_submissions.py | ||
| test_spend_lock_order.py | ||
| test_spendlogs_delivery.py | ||
| test_spendlogs_ledger_parity.py | ||
| test_transaction_atomicity.py | ||
| test_v1_migration_error_logging.py | ||