devin-ai-integration[bot] e85cb4052e test: fix flaky spend-log cleanup budget, login lockout, and wedged Redis tests (#47108) ... * test: stabilize cleanup, lockout, and post-kill timing tests Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(integration): bound the wedged Redis burst p95 by the socket timeout the test sets The burst p95 under a fixed 0.75s cap tracked how fast the box ran the 30 concurrent writes, so a loaded runner failed it at unchanged code. A handler that waits on the wedged publish takes at least the coordination Redis socket timeout, so the test now sets that timeout and asserts the p95 stays under it. * test: pin the lockout clock and bound the wedged Redis burst by the proxy's 2s wait cap The lockout tests now set the login throttle's clock instead of reading the real one, so Retry-After is pinned at 77 and a round-down fails on every run The wedged Redis burst p95 is now bounded by the 2s cap the proxy puts on its own Redis waits, so a burst wait capped under the 5s socket timeout still fails the test The fresh post-kill clients keep the harness's 2s keep-alive expiry, here and in the two tests #47080 changed * test: tell ceil from round in the lockout tests and bound the burst by the imported eviction cap The refused attempt now runs with 76.4s left on the 77s block, where ceil gives 77 but round and int give 76, so both lockout tests fail if Retry-After stops rounding up. The burst bound imports _BULK_EVICTION_WAIT_SECONDS instead of copying its 2s value, so lowering the cap moves the bound with it. * test: bound the wedged Redis burst by the shorter of the eviction cap and the socket timeout Any wait the proxy puts on the stopped Redis lasts at least the shorter of the two, so the bound now follows whichever one a later change lowers. * test: drive the tool index cleanup test with the manual clock and keep the post-kill block as on main The post-kill reset is already fixed on main by making kill() wait for the worker's last thread, so the fresh-client and keep-alive edits go back to main's version. The tool index cleanup test now advances the injected clock instead of timing the real one, and the lockout clock helper gets a type hint. * test: advance the spend log cleanup tests' manual clock through its own method * test: freeze the throttle clock in the login_utils lockout tests and drive the run budget tests with the manual clock --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-29 03:46:32 -07:00
..
__init__.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
_batch_file_caps.py	feat(proxy): cap batch file records, daily batch uploads, and per-file downloads (#43632)	2026-10-06 03:06:36 +00:00
cost_center_service.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
team_metadata_validation_proxy_config.yaml	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_access_group_team_sync.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_agent_management.py	test(integration): cover agents_a2a endpoint contracts (#44650)	2026-10-14 03:40:07 +00:00
test_auto_router_databricks_classifier_writes.py	fix(ci): isolate integration workers and repair test fixtures (#45863)	2026-10-11 01:56:02 -07:00
test_batch_file_usage_caps.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_batch_file_usage_caps_chaos.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_batch_limit_metadata_admin_only.py	feat(proxy): cap batch file records, daily batch uploads, and per-file downloads (#43632)	2026-10-06 03:06:36 +00:00
test_batch_output_file_listing.py	test(integration): stop GET /__observations from draining the upstream log (#47256)	2026-10-18 09:58:05 +00:00
test_budget_list_sorting.py	feat(ui): sort budgets by reset duration (#48107)	2026-10-23 16:21:53 -07:00
test_budget_reset_windows.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_budget_updates.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_claude_code_plugin_installation_preference.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_credential_display_name.py	feat(credentials): add display_name and make credential_name immutable on PATCH (#43148)	2026-10-08 23:49:56 -07:00
test_credential_federation_values.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_credential_migration_endpoint.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_f7_coverage_closeout.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_f7_key_coverage_push.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_fallback_management_public_names.py	test(integration): stop GET /__observations from draining the upstream log (#47256)	2026-10-18 09:58:05 +00:00
test_guardrail_usage_config_guardrail.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_health_routing.py	fix(scim): write a group's roster in one locked transaction instead of one member at a time (#45197)	2026-10-15 10:57:00 -07:00
test_key_aliases.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_block_unblock.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_budget_limits.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_bulk_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_default_allowed_routes.py	feat(key_management)!: apply default_key_generate_params.allowed_routes on key generation (#41236)	2026-10-19 18:53:37 -07:00
test_key_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_delete_revocation.py	test(integration): cover keys_auth endpoint contracts (#44674)	2026-10-14 07:12:28 +00:00
test_key_generate.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_generation_permissions.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_key_health.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_info.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_info_v2.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_list.py	feat(ui): sort virtual keys by expiry, activity, spend and limits (#48074)	2026-10-23 15:45:17 -07:00
test_key_regenerate.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_reset_spend.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_route_contracts.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_key_service_account_generate.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_team_change.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_updates.py	fix(tests): resolve the integration support package without run.py's PYTHONPATH	2026-09-15 21:10:08 -07:00
test_listing_and_health_contracts.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_managed_file_create_ownership.py	fix(managed_files): enforce input file ownership on batch and fine-tuning create (#45855)	2026-10-12 13:58:25 -04:00
test_managed_vector_store_unified_id.py	test(integration): cover vector_stores endpoint contracts (#44739)	2026-10-14 03:59:08 +00:00
test_model_credential_name_updates.py	fix(proxy): validate model credential name only when it changes (#42701)	2026-09-23 07:34:32 -07:00
test_model_deployment_lifecycle.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_model_health_check.py	test(extraction): audit #47473 (#48898)	2026-10-28 17:12:07 -07:00
test_model_hub_custom_metadata.py	feat(model hub): show admin-defined custom tags and metadata from model_info (#46064)	2026-10-20 17:45:06 -07:00
test_model_rename_propagation.py	test(integration): cover model_management endpoint contracts (#44684)	2026-10-14 03:36:47 +00:00
test_organization_budget_clear.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_organization_lifecycle.py	test(integration): stop GET /__observations from draining the upstream log (#47256)	2026-10-18 09:58:05 +00:00
test_partial_update_sequences.py	test: expect 422 for budget refusals in unification, e2e and integration suites	2026-09-20 06:33:57 +00:00
test_policy_attachment_runtime.py	test(integration): cover guardrails_policies endpoint contracts (#44722)	2026-10-14 04:07:26 +00:00
test_project_lifecycle.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_prompt_management.py	test(integration): cover prompts_tags_caching endpoint contracts (#44686)	2026-10-14 04:10:31 +00:00
test_ptu_share_guards.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_scim_admin_group.py	test(scim): audit #47544 (#48791)	2026-10-28 06:08:30 -07:00
test_scim_group_bulk_roster.py	fix(scim)!: delete a group through the team delete's bulk path instead of one member at a time (#47544)	2026-10-21 00:59:23 +00:00
test_scim_group_delete.py	test(scim): audit #47544 (#48791)	2026-10-28 06:08:30 -07:00
test_scim_group_member_not_yet_provisioned.py	test(integration): cover customer reported cache key, cache_control, bedrock request id, responses schema, scim and tag budget contracts (#42785)	2026-09-23 13:19:38 -07:00
test_scim_group_pathless_patch.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_scim_user_lifecycle.py	fix(auth): return a generic 401 for an unknown key (#39787)	2026-10-15 01:05:25 -07:00
test_search_tool_crud.py	test(integration): expect the Exa search envelope's provider_metadata after #47423 (#47572)	2026-10-20 15:29:30 +00:00
test_smoke.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_sso_sign_in.py	fix(sso): enforce free user admission without locking out existing users (#48097)	2026-10-23 14:48:29 -07:00
test_team_available.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_block.py	fix(proxy): refresh cached team on /team/block and /team/unblock (#35643)	2026-10-19 22:50:33 +00:00
test_team_block_unblock.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_blocking_multi_instance.py	fix(proxy): broadcast team cache invalidation on team writes (#46113)	2026-10-13 16:25:22 -04:00
test_team_budget_duration_defaults.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_team_budget_limits.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_bulk_member_add.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_bulk_member_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_daily_activity.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_delete_chaos.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_team_delete_inputs.py	fix(proxy): delete large teams without per-member transaction fan-out (#42998)	2026-09-30 13:49:18 -07:00
test_team_delete_large_membership.py	fix(proxy)!: stop labelling management and health rejections as auth failures (#48739)	2026-10-28 21:49:03 -07:00
test_team_delete_member_add_race.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_team_delete_member_cache_eviction.py	fix(scim): write a group's roster in one locked transaction instead of one member at a time (#45197)	2026-10-15 10:57:00 -07:00
test_team_delete_prometheus.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_team_filter_ui.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_info.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_key_bulk_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_list.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_list_sorting.py	feat(ui): sort every teams table data column (#48109)	2026-10-23 16:21:36 -07:00
test_team_list_v2.py	feat(teams): show caller member spend and budget on Your Teams (#45674)	2026-10-24 17:09:55 -07:00
test_team_member_add.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_budget_cache.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_team_member_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_info_validation.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_lifecycle.py	test(integration): stop GET /__observations from draining the upstream log (#47256)	2026-10-18 09:58:05 +00:00
test_team_member_me.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_reset_budget.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_reset_spend.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_routes.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_team_member_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_metadata_schema.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_metadata_validation.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_team_model.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_new.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_permissions.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_permissions_bulk_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_spend_by_user.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_update.py	feat(proxy): let proxy admins open team metadata to team admins, keeping proxy settings with proxy admins (#46506)	2026-10-14 23:51:44 +00:00
test_team_update_multi_instance.py	fix(proxy): broadcast team cache invalidation on team writes (#46113)	2026-10-13 16:25:22 -04:00
test_tool_policy_user.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00
test_user_delete_revokes_keys.py	test(integration): stop GET /__observations from draining the upstream log (#47256)	2026-10-18 09:58:05 +00:00
test_user_list_sorting.py	feat(ui): sort every users table data column (#48105)	2026-10-23 16:12:51 -07:00
test_user_rate_limit_updates.py	fix(proxy): evict cached user on every proxy for tpm/rpm updates and edit limits in the users UI (#44130)	2026-10-07 16:02:32 -07:00
test_user_routes.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_user_updates_wedged_coordination_redis.py	test: fix flaky spend-log cleanup budget, login lockout, and wedged Redis tests (#47108)	2026-10-29 03:46:32 -07:00
test_users_bulk_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_vector_store_config_ownership.py	test(integration): stop GET /__observations from draining the upstream log (#47256)	2026-10-18 09:58:05 +00:00
test_vector_store_file_list_managed_ids.py	test(integration): give each owned proxy a private database and Redis by default (#47213)	2026-10-18 03:37:41 +00:00