Nate Armstrong ee03f153bd feat(gateway): share router cooldowns and follow proxy key invalidations through Redis (#47017) ... Gateway replicas now share state through the coordination Redis the Python proxy uses (general_settings.coordination_redis, a redis response cache, or REDIS_*): - A deployment one replica cools down is written under Python's deployment:<id>:cooldown key and applied by every other replica's background poll (one MGET a second), so the fleet stops sending to a failing deployment together. allowed_fails counts failures across replicas, as Python's v1 rule does; the v2 failure-rate rule stays per replica, as in Python. Deployments are named by model_info.id, or an id derived from the config that is the same on every replica. - The virtual key cache follows the proxy's litellm_proxy.auth_cache_invalidation channel, so a key blocked, deleted or edited through the admin API (or its team or user) is re-read on every replica at once instead of after up to 60 s. general_settings.user_api_key_cache_ttl sets the key TTL. Nothing is added to the path of a successful request. Without Redis, or while it is down, each replica keeps its own state as before. Redis Cluster and Sentinel are refused at startup for now.		2026-10-17 16:34:03 -07:00
..
auto-close-duplicates.yml	fix(ci): stop the auto-close duplicates job colliding with the required test check	2026-09-05 22:26:38 -07:00
auto_update_price_and_context_window.yml	chore(ci): close the test-census blind spots and move scripts out of workflows/ (#37586)	2026-08-20 10:07:14 -07:00
check-schema-sync.yml	ci: give the remaining pull_request workflows a concurrency group	2026-08-08 03:25:38 +00:00
codeql.yml	ci(codeql): run the default suite on full scans and security-extended on PRs (#45149)	2026-10-07 13:24:28 -07:00
codspeed.yml	chore(ci): drop litellm_internal_staging and litellm_oss_staging references, main is the only trunk (#42745)	2026-09-23 08:14:11 -07:00
compat-matrix-image.yml	feat(compat-matrix): resolve and install the Claude Code CLI per run (#43038)	2026-09-24 14:35:03 -07:00
conventional-commits.yml	security(proxy): keep team callback credentials out of the stored request body (#43217)	2026-09-28 11:16:58 -07:00
cost-map-guard.yml	chore(ci): drop litellm_internal_staging and litellm_oss_staging references, main is the only trunk (#42745)	2026-09-23 08:14:11 -07:00
create-rc-branch.yml	ci: sync the weekly release cycle with Linear releases (#43636)	2026-09-28 17:00:56 -07:00
create-release-branch.yml	ci(release): create stable/X.Y.x line branch on X.Y.0 tags (#29457)	2026-06-01 15:56:34 -07:00
deploy-dev-on-main.yml	ci: trigger the gateway-dev deploy on every main push (#45958)	2026-10-11 16:44:34 +00:00
duplicate_issue_check.yml	ci(duplicate-check): describe the workspace-write sandbox accurately	2026-09-18 14:21:22 -07:00
e2e_record_replay.yml	ci(e2e): record the e2e suite weekly and replay it on weekdays with zero egress (#38163)	2026-08-24 23:49:03 -04:00
guard-fork-dependencies.yml	chore(ci): drop litellm_internal_staging and litellm_oss_staging references, main is the only trunk (#42745)	2026-09-23 08:14:11 -07:00
image-scan.yml	test: migrate proxy security, schema migration and MCP legacy tests (#45937)	2026-10-11 16:17:24 -07:00
issue-keyword-labeler.yml	chore: fixes	2026-04-05 01:30:57 -07:00
issue_classifier.yml	ci(issue-classifier): name every workflow, script and job after the issue it works on	2026-09-18 11:37:55 -07:00
issue_fixed_comment.yml	feat(ci): close open pull requests superseded by a merged fix on their linked issue (#42609)	2026-09-22 18:24:35 -07:00
issue_label_claude_code.yml	ci(issue-classifier): name every workflow, script and job after the issue it works on	2026-09-18 11:37:55 -07:00
issue_label_sync.yml	ci(issue-classifier): name every workflow, script and job after the issue it works on	2026-09-18 11:37:55 -07:00
lens-install-smoke.yml	refactor(lens): connect LiteLLM to the independent Lens service (#45529)	2026-10-09 16:17:05 -07:00
linear-release.yml	ci: sync the weekly release cycle with Linear releases (#43636)	2026-09-28 17:00:56 -07:00
mutation-test.yml	test(ci): repair stale tests and flaky CI infrastructure (#43983)	2026-10-01 17:46:43 +00:00
osv-scan.yml	chore(ci): drop litellm_internal_staging and litellm_oss_staging references, main is the only trunk (#42745)	2026-09-23 08:14:11 -07:00
publish-lint-base-counts.yml	ci: gate undocumented POST routes in the proxy OpenAPI document (#45843)	2026-10-10 21:51:00 +00:00
scorecard.yml	chore: fixes	2026-04-05 01:30:57 -07:00
stale.yml	chore: fixes	2026-04-05 01:30:57 -07:00
sync-schema.yml	chore: fixes	2026-04-05 01:30:57 -07:00
sync-together-ai-models.yml	ci: prepare workflows for main default branch	2026-09-07 12:50:17 -07:00
test-e2e-redis-chaos.yml	test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077)	2026-10-12 13:54:03 -07:00
test-linting.yml	test(e2e): perf rig (out-of-process mocks, PerformanceTestCase runner, per-request limits) and the small_bodies_5rps case (#46713)	2026-10-15 20:14:40 +00:00
test-mcp-dependency-resolution.yml	refactor(sdk): separate core AWS and tokenizer dependencies (#44447)	2026-10-08 19:07:57 -07:00
test-mcp-oauth-e2e.yml	test(e2e): complete OAuth triggers and preserve failure diagnostics	2026-09-19 17:03:38 -07:00
test-merge-smoke.yml	ci: run every CircleCI check from the integration workflow (#45938)	2026-10-11 07:39:16 -07:00
test-rust-loadtest.yml	feat(gateway): load-test kit, Docker build knobs and TCP_NODELAY for the customer proxy (#46806)	2026-10-16 12:42:59 -07:00
test-rust.yml	feat(gateway): share router cooldowns and follow proxy key invalidations through Redis (#47017)	2026-10-17 16:34:03 -07:00
test-terraform-modules.yml	chore(ci): drop litellm_internal_staging and litellm_oss_staging references, main is the only trunk (#42745)	2026-09-23 08:14:11 -07:00
test-terraform-provider.yml	test(ci): repair stale tests and flaky CI infrastructure (#43983)	2026-10-01 17:46:43 +00:00
test-unit.yml	test(rust-bridge): relocate dispatch tests before routing changes (#46926)	2026-10-16 12:29:33 -07:00
test-vscode-extension.yml	chore(ci): drop litellm_internal_staging and litellm_oss_staging references, main is the only trunk (#42745)	2026-09-23 08:14:11 -07:00
weekly_load_anomaly.yml	test(e2e): rename load to perf and consolidate the opt-in into E2E_PERF_TESTS (#46077)	2026-10-12 13:54:03 -07:00
zizmor.yml	chore(ci): drop litellm_internal_staging and litellm_oss_staging references, main is the only trunk (#42745)	2026-09-23 08:14:11 -07:00