litellm/tests/test_litellm/router_utils
mateo-berri 2d49656a2a feat(proxy): split Azure PTU deployments across teams by share
A PTU deployment's model_info takes ptu_shares (team_id -> whole PTUs adding up to
ptu_count) in place of a single team_id. With LITELLM_ENABLE_PTU_COST_ATTRIBUTION on,
routing hides the deployment from teams holding no share, the v3 limiter enforces each
share as a per-team TPM ceiling from Azure's per-model TPM-per-PTU sizing, the daily
flat-cost rollup splits the hourly cost by share, and /team/daily/activity plus the Team
Usage page report PTU-hours next to tokens.
2026-09-24 13:37:08 -07:00
..
test_access_windows.py feat(router): time-windowed team reservation of deployments via model_info.access_windows (#42398) 2026-09-22 13:22:15 -05:00
test_add_retry_fallback_headers.py feat(proxy): expose complexity routing headers (#40792) 2026-09-11 17:14:40 -07:00
test_auto_router_model_naming.py chore(auto-router): merge main into JEV launch branch 2026-09-19 23:28:15 +00:00
test_auto_router_tuning_baseline.py feat(ui): simplify auto-router setup and clarify feature limits (#42625) 2026-09-22 18:03:32 -07:00
test_client_initalization_utils.py feat(router): reject with 429 when a deployment's max_parallel_requests slots are all in use 2026-09-17 18:14:09 +00:00
test_cooldown_cache.py fix(router): give cooldowns their own cache so siblings see a bench in ~1s (#40025) 2026-09-08 10:11:20 -07:00
test_cooldown_handlers.py test(router): annotate return types of team cooldown test helpers 2026-09-13 09:50:12 +00:00
test_fallback_event_handlers.py fix(router): keep refusal gates closed once every fallback entry was tried 2026-09-21 19:50:07 +00:00
test_get_retry_from_policy.py fix(router): add NotFoundErrorRetries so a retry policy can pin 404 retries 2026-09-19 16:25:47 -07:00
test_health_check_allowed_fails_integration.py fix(router): count allowed_fails in the shared router cache so multi-worker proxies bench a deployment fleet-wide (#40224) 2026-09-08 13:54:48 -07:00
test_health_state_cache.py fix(router): treat a breaker-refused Redis read as a miss in the health state cache 2026-09-10 18:16:59 -07:00
test_pattern_match_deployments.py fix(proxy): make the invalid-model 403 path cheap under a burst of rejections (#39892) 2026-09-05 11:53:04 -07:00
test_ptu_shares.py feat(proxy): split Azure PTU deployments across teams by share 2026-09-24 13:37:08 -07:00
test_reasoning_effort_capability.py feat(cost-map): add Azure Foundry pricing for gpt-6-sol and gpt-6-luna (#42747) 2026-09-23 15:17:36 +00:00
test_router_health_check_routing.py feat(health): opt-in model-group allowlist for background health checks and health-check routing (#38539) 2026-08-27 12:25:56 -07:00
test_router_interactions_endpoints.py Gemini managed agents support (#28270) 2026-05-19 16:02:03 -07:00
test_router_utils_common_utils.py fix(router): keep a model's own provider prefix for generic SDK calls 2026-09-04 23:32:26 -07:00