yuneng-jiang b602209ca6 test(integration): hand every harness server a port from one per-worker block (#46761) ... * test(integration): hand every harness server a port from one per-worker block About 45 places in the integration harness picked a port by binding port 0, reading the number back, closing the socket and starting a server on that number later. Another process could take the port in between, which surfaced as "Address already in use" flakes. Earlier fixes retried around the race in single call sites without removing it. tests/integration/_support/ports.py now owns every port the harness picks ahead of a server. Each pytest process claims a 200-port block between 10000 and 32767 by taking an exclusive flock on a per-block lock file in the system temp directory, so parallel runs on one machine never share a block and the lock goes away with the process. The range is above the fixed service ports and below the Linux and macOS ephemeral ranges. Ports go out in order, are never reused in a run, skip anything an outside process already holds, and a process that exhausts its block claims the next free one. The three _free_port copies, worker_endpoints' port-0 binds, free_loopback_port, the owned proxy's lost-port-race retry and the owned Redis retry loop are gone. Tests that restart a server on the same port now allocate that port up front instead of reading it back from the first server. TQ012 in scripts/check_test_quality.py rejects a port-0 bind read back with getsockname anywhere under tests/integration. * ci(integration): record listening sockets and the ephemeral port range * Revert "ci(integration): record listening sockets and the ephemeral port range" This reverts commit d3fafc3da2.		2026-10-15 16:56:40 -07:00
..
_azure_storage_support.py	fix(azure_storage): name Data Lake objects without base64 padding or slashes (#43914)	2026-09-30 18:17:13 -07:00
_logging_only_scope_support.py	feat(guardrails): split logging_only_scope direction from input-failure policy (#45709)	2026-10-10 01:46:39 -07:00
_openinference_support.py	fix(cache): keep cache hits free of unset fields, and follow intentional behavior changes in CircleCI suites (#46359)	2026-10-14 08:56:05 -07:00
_s3_v2_support.py	fix(s3_v2): upload fresh events first, drop terminal failures and hour-old retries by default, opt-in adaptive concurrency (#43022)	2026-09-26 14:58:28 -07:00
_ternary_support.py	feat(focus): add ternary destination for FOCUS export (#46106)	2026-10-12 22:52:40 -07:00
azure_dispatch_support.py	fix(guardrails): restore Azure guardrail get_user_prompt dispatch and allow logging (#44067)	2026-10-01 23:30:32 -07:00
conftest.py	fix(ci): isolate integration workers and repair test fixtures (#45863)	2026-10-11 01:56:02 -07:00
logging_worker_drain_canary.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_akto_logging_only.py	feat(guardrails): support logging_only mode for the Akto guardrail (#45461)	2026-10-08 17:28:08 -07:00
test_apply_guardrail_endpoint.py	fix(cache): keep cache hits free of unset fields, and follow intentional behavior changes in CircleCI suites (#46359)	2026-10-14 08:56:05 -07:00
test_arize_otel_v2_openinference_chaos.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_arize_otel_v2_openinference_family.py	fix(otel): emit OpenInference tool calls and metadata on Arize OTel v2 spans (#43698)	2026-10-08 15:53:07 -07:00
test_arize_otel_v2_openinference_modes.py	fix(ci): isolate integration workers and repair test fixtures (#45863)	2026-10-11 01:56:02 -07:00
test_arize_otel_v2_openinference_sad_edge.py	fix(otel): emit OpenInference tool calls and metadata on Arize OTel v2 spans (#43698)	2026-10-08 15:53:07 -07:00
test_arize_otel_v2_openinference_spans.py	fix(proxy): classify /v1/messages pass-through streams as Anthropic on any host (#45602)	2026-10-09 11:57:03 -07:00
test_azure_content_safety_audit.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_azure_content_safety_dispatch.py	fix(guardrails): restore Azure guardrail get_user_prompt dispatch and allow logging (#44067)	2026-10-01 23:30:32 -07:00
test_azure_content_safety_dispatch_resilience.py	test(integration): hand every harness server a port from one per-worker block (#46761)	2026-10-15 16:56:40 -07:00
test_azure_content_safety_endpoints.py	fix(guardrails): scan Responses API input in Azure Prompt Shield (#43786)	2026-09-30 22:48:20 -07:00
test_azure_storage_chaos.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_azure_storage_client_ttl.py	fix(azure_storage): keep the DataLakeServiceClient alive until its TTL elapses (#43082)	2026-09-30 18:50:15 -07:00
test_azure_storage_file_names.py	fix(azure_storage): keep client call ids from sharing one Data Lake file (#44099)	2026-10-01 23:23:37 -07:00
test_batch_line_items_cold_storage.py	feat(batches): store each batch line's request and response in S3 and GCS (#41691)	2026-10-15 11:32:56 -07:00
test_bedrock_error_request_id.py	test(integration): cover customer reported cache key, cache_control, bedrock request id, responses schema, scim and tag budget contracts (#42785)	2026-09-23 13:19:38 -07:00
test_bedrock_guardrail_attachments.py	fix(ci): isolate integration workers and repair test fixtures (#45863)	2026-10-11 01:56:02 -07:00
test_cache_hit_guardrail_metrics.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_cache_hit_guardrail_metrics_chaos.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_callback_delivery.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_custom_logger_redaction.py	fix(logging): redact nested callback input and provider response fields (#45923)	2026-10-13 12:25:56 -07:00
test_datadog_logging_delivery.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
test_file_usage_counter_span.py	feat(proxy): cap batch file records, daily batch uploads, and per-file downloads (#43632)	2026-10-06 03:06:36 +00:00
test_grayswan_wire.py	fix(grayswan): send request conversation and tool calls to post-call monitor (#43770)	2026-09-30 17:52:53 -07:00
test_grayswan_wire_chaos.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_guardrail_attachment.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_guardrail_effects.py	test(integration): hand every harness server a port from one per-worker block (#46761)	2026-10-15 16:56:40 -07:00
test_guardrail_load_balancing.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_guardrail_stream_scope.py	feat(guardrails): per-mode stream_scope with bedrock stream and pass-through fixes (#43801)	2026-10-08 13:46:53 -07:00
test_guardrail_stream_scope_chaos.py	test(integration): hand every harness server a port from one per-worker block (#46761)	2026-10-15 16:56:40 -07:00
test_guardrail_stream_scope_matrix.py	test(integration): update stale CircleCI integration expectations (#46570)	2026-10-14 18:21:59 -07:00
test_guardrail_timeout_all_providers.py	feat(guardrails): add Wingback guardrail integration (#46136)	2026-10-12 22:18:10 -07:00
test_langfuse_delivery.py	test(integration): isolate shared proxy state behind six order-dependent flakes (#46172)	2026-10-13 09:55:11 -07:00
test_langsmith_logging_delivery.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
test_langtrace_delivery.py	test(integration): hand every harness server a port from one per-worker block (#46761)	2026-10-15 16:56:40 -07:00
test_logging_only_scope_chaos.py	test(integration): hand every harness server a port from one per-worker block (#46761)	2026-10-15 16:56:40 -07:00
test_logging_only_scope_config.py	test(integration): update stale CircleCI integration expectations (#46570)	2026-10-14 18:21:59 -07:00
test_logging_only_scope_runtime.py	feat(guardrails): split logging_only_scope direction from input-failure policy (#45709)	2026-10-10 01:46:39 -07:00
test_logging_worker_drain.py	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
test_otel_conversation_id.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_otel_excluded_services.py	test(integration): isolate shared proxy state behind six order-dependent flakes (#46172)	2026-10-13 09:55:11 -07:00
test_otel_excluded_services_matrix.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_otel_team_capture_message_content.py	feat(otel)!: let a team capture_message_content override the global setting for its OTel v2 destination (#44264)	2026-10-10 13:52:32 -07:00
test_otel_text_completion_choices.py	fix(otel): keep text completion choice fields beside the synthesized message (#42537)	2026-09-22 14:24:32 -07:00
test_otel_trace_response_header.py	feat(proxy): return the W3C traceresponse header on traced responses (#42079)	2026-10-14 18:12:34 -07:00
test_otel_v1_request_trace.py	fix(caching): key response cache by router model group in litellm_metadata (#44542)	2026-10-05 17:06:21 +00:00
test_passthrough_upstream_error_chaos.py	test(integration): hand every harness server a port from one per-worker block (#46761)	2026-10-15 16:56:40 -07:00
test_passthrough_upstream_error_visibility.py	test(integration): cover pass_through endpoint contracts (#44690)	2026-10-14 07:38:17 +00:00
test_presidio_entity_masking.py	test(integration): cover guardrails_policies endpoint contracts (#44722)	2026-10-14 04:07:26 +00:00
test_presidio_streaming_output.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_prometheus_project_alias_label.py	fix(prometheus): skip custom metadata labels a metric already carries (#46267)	2026-10-13 18:20:52 -07:00
test_prometheus_request_metrics.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_prometheus_series_cap.py	feat(prometheus): cap series per metric for every labeled metric (#44420)	2026-10-06 01:28:44 +00:00
test_prometheus_series_cap_chaos.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_prometheus_shared_custom_labels.py	test(integration): wait on the right signal in five flaky integration contracts (#46737)	2026-10-15 13:48:51 -07:00
test_realtime_guardrail_translation.py	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
test_s3_v2_flush_surfaces.py	fix(s3_v2): upload fresh events first, drop terminal failures and hour-old retries by default, opt-in adaptive concurrency (#43022)	2026-09-26 14:58:28 -07:00
test_s3_v2_partition_granularity.py	test(integration): give chaos and timing tests a harness API and gate raw signals (#46031)	2026-10-12 05:27:33 -07:00
test_s3_v2_streaming_failure_dedupe.py	test(integration): cut CircleCI proxy boot time with concurrent worker stacks and single-worker test proxies (#46037)	2026-10-12 09:48:42 -07:00
test_s3_v2_upload_fanout.py	test(integration): wait on the right signal in five flaky integration contracts (#46737)	2026-10-15 13:48:51 -07:00
test_signoz_delivery.py	test(integration): remove BUG skips for 3 tests that pass on main (#46725)	2026-10-15 18:50:26 +00:00
test_straiker_v3_platform.py	test(integration): hand every harness server a port from one per-worker block (#46761)	2026-10-15 16:56:40 -07:00
test_ternary_focus_export.py	feat(focus): add ternary destination for FOCUS export (#46106)	2026-10-12 22:52:40 -07:00
test_wingback_guardrail.py	feat(guardrails): add Wingback guardrail integration (#46136)	2026-10-12 22:18:10 -07:00
test_xecguard_wire.py	refactor(types): replace Any with proven types in 7 files (#43704)	2026-09-29 06:12:58 -07:00