yuneng-jiang 9b53ee878f perf(ci): isolate and shard integration suites (#44146) ... * perf(ci): distribute unit cases and reuse security sweep connections * revert(ci): reject first speed trial after new failures * perf(ci): avoid repeated test discovery and parsing * perf(ci): isolate parallel security workers * revert(ci): restore measured security execution isolation * perf(tests): reuse source scans and deduplicate cache cleanup * perf(ci): restore parallel security with safe log batching * test(ci): isolate fixture state and schema comparisons * test(ci): make schema and scheduler fixtures deterministic * test(ci): drain queued logging before fixture teardown * test(ci): preserve logging delivery without idle worker restarts * test(ci): keep guardrail sinks available during parallel bursts * test(ci): isolate full proxy lifecycle from gateway imports * test(ci): preserve first failure responses and sweep evidence * test(ci): restore documentation URL settings between cases * test(ci): isolate open MCP tools in private gateways * test(ci): group private MCP cases and handle exited workers * test(ci): retain proxy exits and MCP failure details * test(ci): repair merge interactions with main Key the schema shard's full clone on artifact-name, since main removed the unit-flag input. Give each owned Redis its own log file again. Hand the realtime transcription tests main added a logging object whose dispatch handlers are awaitable, so the per-test logging drain no longer waits on a MagicMock task forever * perf(ci): shard owned integration cases and close lifecycle leaks * fix(ci): qualify shard execution and harden interrupted cleanup * fix(ci): bound worker supervision and own fault traffic * perf(ci): reuse unparametrized fixtures across bounded case groups * fix(ci): preserve boot fault allowances and complete exit records * test(ci): tolerate startup retries and retain readiness details * perf(ci): balance integration shards by recorded duration * fix(ci): load migration database helpers only for workers		2026-10-10 11:15:19 -07:00
..
fixtures	refactor(repositories): daily activity repository with centralized bounded usage queries (#43398)	2026-10-01 16:02:01 -07:00
golden	feat(proxy): bounded daily activity routes for all usage entities (#43408)	2026-10-01 16:57:23 -07:00
_daily_activity_fixtures.py	fix(daily_activity): keep NULL entity ids when excluding entity ids (#44139)	2026-10-01 21:19:48 -07:00
test_background_interaction_settlement.py	feat(interactions): durable cross-pod settlement for background interaction billing (#41955)	2026-10-02 21:08:38 -07:00
test_background_response_poll_retirement.py	fix(proxy): mark background responses stale_expired when provider returns 404 (#41724)	2026-10-08 10:35:52 -07:00
test_batch_completion_accounting.py	feat(spend_logs): configure which metadata fields are stored in LiteLLM_SpendLogs (#44659)	2026-10-08 14:51:44 -07:00
test_batch_enqueued_tokens_redis_lua.py	test(proxy): migrate DB and Redis backed proxy tests into tests/integration (#43996)	2026-10-01 09:23:36 -07:00
test_batch_observability.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_batch_poll_starvation.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_budget_limit_envelopes.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_cache_and_quota.py	test(integration): run the Langfuse DB-callback test on its own scratch database (#43288)	2026-09-26 00:15:56 -07:00
test_chaos_burst_spend_once.py	refactor(types): replace Any with proven types in 7 files (#43704)	2026-09-29 06:12:58 -07:00
test_daily_activity_aggregated_breakdowns.py	refactor(repositories): daily activity repository with centralized bounded usage queries (#43398)	2026-10-01 16:02:01 -07:00
test_daily_activity_key_alias_probes.py	fix(proxy): look up hashed key names with two spend log rows per key (#43656)	2026-09-29 20:21:55 -07:00
test_daily_activity_key_metadata_query_timeout.py	fix(spend-tracking): stop caching failed spend-log metadata lookups as confirmed misses (#43560)	2026-10-05 22:36:25 +00:00
test_daily_activity_key_owner.py	fix(proxy): recover session key owners from daily spend for usage attribution (#43642)	2026-09-29 15:36:09 -07:00
test_daily_activity_key_owner_faults.py	test: repair stale and polluting tests red on scheduled main CI (#44229)	2026-10-02 21:32:17 +00:00
test_daily_activity_key_owner_traffic.py	fix(proxy): look up hashed key names with two spend log rows per key (#43656)	2026-09-29 20:21:55 -07:00
test_daily_activity_repository.py	fix(daily_activity): keep NULL entity ids when excluding entity ids (#44139)	2026-10-01 21:19:48 -07:00
test_daily_activity_routes.py	fix(daily_activity): keep NULL entity ids when excluding entity ids (#44139)	2026-10-01 21:19:48 -07:00
test_daily_rollup_retry.py	test(integration): add read-replica routing harness to the CircleCI integration suite (#42692)	2026-09-24 00:25:03 -07:00
test_daily_tag_spend_retention.py	feat(proxy): add maximum_daily_tag_spend_retention_period cleanup setting (#39221)	2026-09-26 15:07:56 -07:00
test_disconnected_bedrock_messages_stream_billing.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_end_user_spend_without_proxy_user.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_failed_dispatch_tokens.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_filtered_ledger.py	test: add extension and browser integration contracts	2026-09-16 13:15:53 -07:00
test_global_spend_report.py	test(integration): move legacy proxy, router and Redis tests into tests/integration (#44128)	2026-10-01 23:00:54 -07:00
test_image_generation_key_spend.py	test(integration): move legacy proxy, router and Redis tests into tests/integration (#44128)	2026-10-01 23:00:54 -07:00
test_key_budget_lockout.py	test(integration): move legacy proxy, router and Redis tests into tests/integration (#44128)	2026-10-01 23:00:54 -07:00
test_key_metadata_recovery_dropped_connection.py	fix(spend-tracking): stop caching failed spend-log metadata lookups as confirmed misses (#43560)	2026-10-05 22:36:25 +00:00
test_key_metadata_recovery_probe_bounds.py	fix(proxy-extras): build the SpendLogs indexes in the migration job instead of in migrations (#43948)	2026-10-01 14:12:22 -07:00
test_legacy_spend_logs_row_cap.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_messages_stream_usage_cost.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_model_router_selected_model.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_normalized_error_long_message.py	fix(logging): scan the exceeded budget wording linearly so a crafted error message cannot stall the proxy (#42778)	2026-09-23 22:44:23 -07:00
test_org_budget_cli_session_token.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_passthrough_budget_reservation.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_passthrough_request_tags.py	fix(proxy): carry key, team and project tags into pass-through spend logs (#42662)	2026-10-02 19:38:44 +00:00
test_prompt_caching_requests_pagination.py	test(proxy): migrate DB and Redis backed proxy tests into tests/integration (#43996)	2026-10-01 09:23:36 -07:00
test_redis_ttl_preserving_token_increment.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_reset_budget_leader_election.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_responses_bridge_spend_once.py	fix(logging): log spend once for large non-streaming requests on the chat to Responses bridge (#44508)	2026-10-06 21:23:19 +00:00
test_responses_cache_write_itemization.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_roi_branch_spend.py	fix(caching): key response cache by router model group in litellm_metadata (#44542)	2026-10-05 17:06:21 +00:00
test_service_tier_stream_billing.py	fix(streaming): keep the served service_tier on streamed chunks and spend rows (#42870)	2026-09-29 12:54:17 -07:00
test_session_total_spend.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_shutdown_flush.py	test(integration): add read-replica routing harness to the CircleCI integration suite (#42692)	2026-09-24 00:25:03 -07:00
test_spend_attribution_contracts.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_spend_calculate.py	fix(pricing): drop the unpublished cached rate from the Gemini Live preview entries (#42651)	2026-09-22 20:35:34 -07:00
test_spend_capture_rate_captured_spend.py	test(proxy): migrate DB and Redis backed proxy tests into tests/integration (#43996)	2026-10-01 09:23:36 -07:00
test_spend_log_read_scope.py	fix(proxy): share ownership permissions for spend logs and traces (#44239)	2026-10-03 01:38:54 +00:00
test_spend_log_tool_payload_content.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_spend_log_write_batching.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_spend_logs_metadata_fields.py	feat(spend_logs): configure which metadata fields are stored in LiteLLM_SpendLogs (#44659)	2026-10-08 14:51:44 -07:00
test_spend_rollup_accuracy.py	test(integration): move legacy proxy, router and Redis tests into tests/integration (#44128)	2026-10-01 23:00:54 -07:00
test_stream_alias_billing.py	fix(proxy): stamp the client alias on a copy of each streamed chunk so pricing sees the deployment model (#44341)	2026-10-03 06:44:52 +00:00
test_tag_budget_enforcement.py	feat(proxy): enforce tpm_limit and rpm_limit set on tag objects (#41807)	2026-09-24 18:11:57 -07:00
test_team_budget_enforcement.py	test(integration): move legacy proxy, router and Redis tests into tests/integration (#44128)	2026-10-01 23:00:54 -07:00
test_team_daily_activity_aggregated.py	test(integration): regression tests for August cost tracking and budgeting bugs (#42622)	2026-09-23 04:13:03 +00:00
test_team_member_budget_alerts.py	feat(proxy): email alerts at configured percentages of a team member budget (#42665)	2026-09-26 02:42:45 +00:00
test_team_member_spend.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_team_member_spend_flush.py	fix(proxy): pass team member spend rows as jsonb so a $0 flush cannot poison the pool connection (#43029)	2026-09-24 20:44:56 +00:00
test_user_budget_on_team_keys.py	test(integration): regression tests for July cost tracking, budgeting and spend bugs (#42694)	2026-09-23 09:51:56 -07:00
test_vertex_image_regional_uplift.py	perf(ci): isolate and shard integration suites (#44146)	2026-10-10 11:15:19 -07:00
test_vertex_regional_uplift_spend.py	fix(vertex_ai): add regional endpoint uplift to gemini-3.1-flash-image (#44673)	2026-10-05 21:00:22 -07:00