yuneng-jiang b602209ca6 test(integration): hand every harness server a port from one per-worker block (#46761) ... * test(integration): hand every harness server a port from one per-worker block About 45 places in the integration harness picked a port by binding port 0, reading the number back, closing the socket and starting a server on that number later. Another process could take the port in between, which surfaced as "Address already in use" flakes. Earlier fixes retried around the race in single call sites without removing it. tests/integration/_support/ports.py now owns every port the harness picks ahead of a server. Each pytest process claims a 200-port block between 10000 and 32767 by taking an exclusive flock on a per-block lock file in the system temp directory, so parallel runs on one machine never share a block and the lock goes away with the process. The range is above the fixed service ports and below the Linux and macOS ephemeral ranges. Ports go out in order, are never reused in a run, skip anything an outside process already holds, and a process that exhausts its block claims the next free one. The three _free_port copies, worker_endpoints' port-0 binds, free_loopback_port, the owned proxy's lost-port-race retry and the owned Redis retry loop are gone. Tests that restart a server on the same port now allocate that port up front instead of reading it back from the first server. TQ012 in scripts/check_test_quality.py rejects a port-0 bind read back with getsockname anywhere under tests/integration. * ci(integration): record listening sockets and the ephemeral port range * Revert "ci(integration): record listening sockets and the ephemeral port range" This reverts commit d3fafc3da2.		2026-10-15 16:56:40 -07:00
..
__init__.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
_batch_file_caps.py	feat(proxy): cap batch file records, daily batch uploads, and per-file downloads (#43632)	2026-10-06 03:06:36 +00:00
cost_center_service.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
team_metadata_validation_proxy_config.yaml	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_access_group_team_sync.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_agent_management.py	test(integration): cover agents_a2a endpoint contracts (#44650)	2026-10-14 03:40:07 +00:00
test_auto_router_databricks_classifier_writes.py	fix(ci): isolate integration workers and repair test fixtures (#45863)	2026-10-11 01:56:02 -07:00
test_batch_file_usage_caps.py	feat(proxy): cap batch file records, daily batch uploads, and per-file downloads (#43632)	2026-10-06 03:06:36 +00:00
test_batch_file_usage_caps_chaos.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_batch_limit_metadata_admin_only.py	feat(proxy): cap batch file records, daily batch uploads, and per-file downloads (#43632)	2026-10-06 03:06:36 +00:00
test_batch_output_file_listing.py	fix(proxy): save file details for every batch output file so they list and retrieve (#41761)	2026-10-08 18:51:45 -07:00
test_budget_reset_windows.py	feat(proxy): report when each per-model budget window resets (#45797)	2026-10-15 10:56:45 -07:00
test_budget_updates.py	test(integration): cover budgets_spend endpoint contracts (#44736)	2026-10-14 06:58:22 +00:00
test_claude_code_plugin_installation_preference.py	feat(claude-code): emit installationPreference in marketplace.json entries (#41430)	2026-10-14 07:59:25 +00:00
test_credential_display_name.py	feat(credentials): add display_name and make credential_name immutable on PATCH (#43148)	2026-10-08 23:49:56 -07:00
test_credential_federation_values.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_credential_migration_endpoint.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_f7_coverage_closeout.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_f7_key_coverage_push.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_fallback_management_public_names.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_guardrail_usage_config_guardrail.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_health_routing.py	fix(scim): write a group's roster in one locked transaction instead of one member at a time (#45197)	2026-10-15 10:57:00 -07:00
test_key_aliases.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_block_unblock.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_budget_limits.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_bulk_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_delete_revocation.py	test(integration): cover keys_auth endpoint contracts (#44674)	2026-10-14 07:12:28 +00:00
test_key_generate.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_generation_permissions.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_key_health.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_info.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_info_v2.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_list.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_regenerate.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_reset_spend.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_route_contracts.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_key_service_account_generate.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_team_change.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_key_updates.py	fix(tests): resolve the integration support package without run.py's PYTHONPATH	2026-09-15 21:10:08 -07:00
test_listing_and_health_contracts.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_managed_file_create_ownership.py	fix(managed_files): enforce input file ownership on batch and fine-tuning create (#45855)	2026-10-12 13:58:25 -04:00
test_managed_vector_store_unified_id.py	test(integration): cover vector_stores endpoint contracts (#44739)	2026-10-14 03:59:08 +00:00
test_model_credential_name_updates.py	fix(proxy): validate model credential name only when it changes (#42701)	2026-09-23 07:34:32 -07:00
test_model_deployment_lifecycle.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_model_health_check.py	test(integration): cover health_routing endpoint contracts (#44744)	2026-10-14 06:34:22 +00:00
test_model_rename_propagation.py	test(integration): cover model_management endpoint contracts (#44684)	2026-10-14 03:36:47 +00:00
test_organization_budget_clear.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_organization_lifecycle.py	fix(auth): return a generic 401 for an unknown key (#39787)	2026-10-15 01:05:25 -07:00
test_partial_update_sequences.py	test: expect 422 for budget refusals in unification, e2e and integration suites	2026-09-20 06:33:57 +00:00
test_policy_attachment_runtime.py	test(integration): cover guardrails_policies endpoint contracts (#44722)	2026-10-14 04:07:26 +00:00
test_project_lifecycle.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_prompt_management.py	test(integration): cover prompts_tags_caching endpoint contracts (#44686)	2026-10-14 04:10:31 +00:00
test_ptu_share_guards.py	feat(proxy): split Azure PTU deployments across teams with per-team PTU ceilings and PTU-hour reporting (#43043)	2026-10-15 18:44:30 +00:00
test_scim_admin_group.py	test(integration): cover scim endpoint contracts (#44656)	2026-10-14 03:41:54 +00:00
test_scim_group_bulk_roster.py	fix(scim): write a group's roster in one locked transaction instead of one member at a time (#45197)	2026-10-15 10:57:00 -07:00
test_scim_group_member_not_yet_provisioned.py	test(integration): cover customer reported cache key, cache_control, bedrock request id, responses schema, scim and tag budget contracts (#42785)	2026-09-23 13:19:38 -07:00
test_scim_group_pathless_patch.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_scim_user_lifecycle.py	fix(auth): return a generic 401 for an unknown key (#39787)	2026-10-15 01:05:25 -07:00
test_search_tool_crud.py	test(integration): cover small_inference endpoint contracts (#44654)	2026-10-14 04:06:15 +00:00
test_smoke.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_sso_sign_in.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_team_available.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_block.py	test(integration): cover teams endpoint contracts (#44705)	2026-10-14 06:29:20 +00:00
test_team_block_unblock.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_blocking_multi_instance.py	fix(proxy): broadcast team cache invalidation on team writes (#46113)	2026-10-13 16:25:22 -04:00
test_team_budget_duration_defaults.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_team_budget_limits.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_bulk_member_add.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_bulk_member_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_daily_activity.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_delete_chaos.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_team_delete_inputs.py	fix(proxy): delete large teams without per-member transaction fan-out (#42998)	2026-09-30 13:49:18 -07:00
test_team_delete_large_membership.py	fix(scim): write a group's roster in one locked transaction instead of one member at a time (#45197)	2026-10-15 10:57:00 -07:00
test_team_delete_member_add_race.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_team_delete_member_cache_eviction.py	fix(scim): write a group's roster in one locked transaction instead of one member at a time (#45197)	2026-10-15 10:57:00 -07:00
test_team_delete_prometheus.py	fix(scim): write a group's roster in one locked transaction instead of one member at a time (#45197)	2026-10-15 10:57:00 -07:00
test_team_filter_ui.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_info.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_key_bulk_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_list.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_list_v2.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_add.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_budget_cache.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_team_member_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_info_validation.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_lifecycle.py	test(integration): cover teams endpoint contracts (#44705)	2026-10-14 06:29:20 +00:00
test_team_member_me.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_reset_budget.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_reset_spend.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_member_routes.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_team_member_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_metadata_schema.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_metadata_validation.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_team_model.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_new.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_permissions.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_permissions_bulk_update.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_spend_by_user.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_team_update.py	feat(proxy): let proxy admins open team metadata to team admins, keeping proxy settings with proxy admins (#46506)	2026-10-14 23:51:44 +00:00
test_team_update_multi_instance.py	fix(proxy): broadcast team cache invalidation on team writes (#46113)	2026-10-13 16:25:22 -04:00
test_tool_policy_user.py	test(integration): cover mcp_management endpoint contracts (#44687)	2026-10-14 03:55:50 +00:00
test_user_delete_revokes_keys.py	fix(scim): write a group's roster in one locked transaction instead of one member at a time (#45197)	2026-10-15 10:57:00 -07:00
test_user_rate_limit_updates.py	fix(proxy): evict cached user on every proxy for tpm/rpm updates and edit limits in the users UI (#44130)	2026-10-07 16:02:32 -07:00
test_user_routes.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_user_updates_wedged_coordination_redis.py	fix(proxy): evict the cached user on every proxy for every /user/update and /user/bulk_update (#46500)	2026-10-14 13:25:20 -07:00
test_users_bulk_delete.py	test: migrate tests/proxy_behavior into integration and unit tiers (#45939)	2026-10-11 08:28:42 -07:00
test_vector_store_config_ownership.py	test(integration): cover vector_stores endpoint contracts (#44739)	2026-10-14 03:59:08 +00:00
test_vector_store_file_list_managed_ids.py	test(integration): hand every harness server a port from one per-worker block (#46761)	2026-10-15 16:56:40 -07:00