Shivam Rawat 15154a40a8 fix(proxy): let admins make per-model key/team rate limits a hard 429 instead of falling back (#45459) ... * fix(proxy): let admins make per-model key/team rate limits a hard 429 instead of falling back Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): sync per-model rate limit API types Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): type per-model fallback setting access Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): keep the per-model hard cap inside the fallback loop and test it through the real limiter * fix(proxy): list the per-model hard cap setting on the settings page and cover every per-model descriptor * fix(proxy): read disable_fallbacks_on_per_model_rate_limits as a boolean value and cover the team-wide per-model cap * test(proxy): cover per-model rate limit 429s skipping fallbacks on a live proxy --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-09 23:10:23 -07:00
..
either_role.json	test(integration): add read-replica routing harness to the CircleCI integration suite (#42692)	2026-09-24 00:25:03 -07:00
test_advisor_failure_cooldown.py	test(integration): regression tests for July provider translation, routing and streaming bugs (#42693)	2026-09-23 09:51:06 -07:00
test_audit_any_sweep_chaos.py	test: fix stale and flaky tests across CircleCI, GHA and Buildkite (#45530)	2026-10-09 11:40:14 -07:00
test_complexity_router_databricks_classifier.py	feat(decisions): add Databricks ai_decide as a /v1/decisions provider and auto-router decider (#45200)	2026-10-09 16:19:23 -07:00
test_complexity_router_llm_classifier.py	refactor(types): replace Any with proven types in 7 files (#43844)	2026-10-02 02:47:47 -07:00
test_deployment_num_retries_generic_routes_wire.py	fix(router): retry a /v1/messages stream the provider drops before the first content chunk (#44276)	2026-10-05 22:53:39 +00:00
test_encrypted_content_affinity_no_peer.py	fix(router): serve Responses turns from a sibling when the encrypted content origin has no boundary peer (#43015)	2026-09-24 17:31:43 -07:00
test_end_user_region_routing.py	test(integration): move legacy proxy, router and Redis tests into tests/integration (#44128)	2026-10-01 23:00:54 -07:00
test_fallback_hop_foreign_encrypted_reasoning.py	fix(router): drop the encrypted reasoning a fallback hop's target cannot decrypt (#45393)	2026-10-08 17:30:01 -07:00
test_fallback_retry_header_contracts.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_include_fallback_errors_wire.py	fix(router): keep include_fallback_errors off the provider call on the sync Router path (#45218)	2026-10-07 22:25:12 -07:00
test_key_max_parallel_requests.py	test(integration): move legacy proxy, router and Redis tests into tests/integration (#44128)	2026-10-01 23:00:54 -07:00
test_key_tpm_reservation.py	test(integration): regression tests for July provider translation, routing and streaming bugs (#42693)	2026-09-23 09:51:06 -07:00
test_messages_stream_retry_budget_sources_owned_proxy.py	fix(router): retry a /v1/messages stream the provider drops before the first content chunk (#44276)	2026-10-05 22:53:39 +00:00
test_observed_routing.py	test: cover provider wire contracts, streaming and recovery	2026-09-16 12:48:30 -07:00
test_payment_required_cooldown.py	fix(exceptions): map upstream 402 to PaymentRequiredError and cool down 402 deployments (#44879)	2026-10-06 20:35:13 -07:00
test_payment_required_mapping.py	fix(exceptions): map upstream 402 to PaymentRequiredError and cool down 402 deployments (#44879)	2026-10-06 20:35:13 -07:00
test_pdf_document_pre_call_checks_owned_proxy.py	fix(token_counter): price a base64 PDF document per page instead of as one image (#45301)	2026-10-08 21:20:46 -07:00
test_per_model_rate_limit_fallbacks.py	fix(proxy): let admins make per-model key/team rate limits a hard 429 instead of falling back (#45459)	2026-10-09 23:10:23 -07:00
test_per_model_rate_limit_fallbacks_lifecycle.py	fix(proxy): let admins make per-model key/team rate limits a hard 429 instead of falling back (#45459)	2026-10-09 23:10:23 -07:00
test_priority_model_tpm_enforcement.py	test(integration): regression tests for July provider translation, routing and streaming bugs (#42693)	2026-09-23 09:51:06 -07:00
test_priority_rate_limit_headers.py	chore(lint): remove the LIT002 mutable-construction rule (#43971)	2026-10-01 12:24:02 -07:00
test_priority_scheduler_queue_cleanup.py	test(integration): boot owned proxies with a readiness-sized worker healthcheck budget (#45292)	2026-10-07 23:40:26 -07:00
test_prompt_caching_affinity_tool_call_marks.py	fix(caching): count tool_call cache_control marks in the injection census (#43556)	2026-10-03 17:33:48 -07:00
test_redis_increment_with_floor.py	ci(circleci): test Redis behavior against local Redis and print short tracebacks (#44062)	2026-10-01 13:00:54 -07:00
test_redis_recovery.py	test(integration): add read-replica routing harness to the CircleCI integration suite (#42692)	2026-09-24 00:25:03 -07:00
test_stale_cost_map_boot.py	fix(caching): key response cache by router model group in litellm_metadata (#44542)	2026-10-05 17:06:21 +00:00
test_team_model_tpm_limit.py	test(integration): regression tests for July provider translation, routing and streaming bugs (#42693)	2026-09-23 09:51:06 -07:00
test_team_tag_routing.py	test(integration): move legacy proxy, router and Redis tests into tests/integration (#44128)	2026-10-01 23:00:54 -07:00
test_usage_based_routing_redis_reads.py	test: fix stale and flaky tests across CircleCI, GHA and Buildkite (#45530)	2026-10-09 11:40:14 -07:00
test_user_config_routing.py	test: take keys out of the legacy proxy, enterprise and mcp unit tests before moving them (#42901)	2026-09-24 14:56:52 -07:00