mateo-berri 125587d286 feat(e2e): canonical content-based match keys for record-and-replay ... Replay previously matched interactions by transport verb and path in recorded order, so a request whose body drifted from the recording silently replayed the stale response, and reordering two independent calls broke replay even though both were recorded. Match keys are now canonical: fixture_canonical.py strips volatile headers and credential fields, replaces unique markers, generated ids, uuids, and timestamps with fixed placeholders, sorts object keys, and hashes what remains, so a key is stable across runs and machines while any real content drift is a hard ReplayMiss naming the computed key, the closest recorded key with its file, and a content diff, with no fallthrough to a live call. Matching is order-independent across distinct keys and FIFO within one key. Recording now also redacts credential body and form fields (not just auth headers) so provider keys never land in bundles. Resolves LIT-5741		2026-08-19 14:33:22 -07:00
..
a2a	test(e2e): settle control-plane writes across every replica, not just one	2026-08-07 19:36:30 -07:00
access_control	test(e2e): assert the model allow-list permits, not only denies	2026-08-13 13:37:31 -07:00
batches	test(e2e): skip the batch rate-limiter spend-row test pending LIT-5027 (#35301)	2026-07-31 01:20:04 +00:00
claude_code	test(e2e): replay a real tool-search assistant turn back to Bedrock Invoke (#36856)	2026-08-17 11:59:26 -07:00
coverage_registry	test(e2e): replay a real tool-search assistant turn back to Bedrock Invoke (#36856)	2026-08-17 11:59:26 -07:00
guardrails	test(e2e): vendor API testing coverage (#34557)	2026-08-12 01:07:52 +00:00
llm_translation	test(e2e): skip the bedrock web search cell the stack cannot provision	2026-08-15 16:09:02 -07:00
load	test(e2e): move load/perf testing out of the main suite and drop the vllm passthrough test (#35820)	2026-08-04 14:12:25 -07:00
logging	test(e2e): assert provider error shape instead of pinned prose	2026-08-15 16:08:52 -07:00
management	test(e2e): add reproducers for passthrough and model budget gaps (#34657)	2026-08-11 18:15:34 -07:00
mcp	test(e2e): settle control-plane writes across every replica, not just one	2026-08-07 19:36:30 -07:00
other	test(e2e): add Other suite and Guardrails coverage incl. an MCP tool-call guardrail (#34149)	2026-07-21 14:06:29 -07:00
quota_management	test(e2e): add reproducers for passthrough and model budget gaps (#34657)	2026-08-11 18:15:34 -07:00
router	test(e2e): add reliability suite covering fallback, timeout, and cache behavior (#34023)	2026-07-20 23:06:46 +00:00
ui	test(e2e/ui): assert the log drawer chevrons by their lucide classes	2026-08-15 17:50:40 -07:00
CLAUDE.md	feat(e2e): canonical content-based match keys for record-and-replay	2026-08-19 14:33:22 -07:00
conftest.py	feat(e2e): fail passed replays that leave recorded interactions unconsumed	2026-08-18 14:34:23 -07:00
CONTRIBUTING.md	feat(e2e): add record/replay transport seam and fixture bundle format	2026-08-18 14:08:00 -07:00
e2e_config.py	feat(e2e): add record/replay transport seam and fixture bundle format	2026-08-18 14:08:00 -07:00
e2e_db.py	test(e2e): guard destructive spend-log truncate behind an explicit opt-in (#33751)	2026-07-20 08:47:39 -07:00
e2e_http.py	test(e2e): vendor API testing coverage (#34557)	2026-08-12 01:07:52 +00:00
fixture_bundle.py	feat(e2e): canonical content-based match keys for record-and-replay	2026-08-19 14:33:22 -07:00
fixture_canonical.py	feat(e2e): canonical content-based match keys for record-and-replay	2026-08-19 14:33:22 -07:00
fixture_transport.py	feat(e2e): canonical content-based match keys for record-and-replay	2026-08-19 14:33:22 -07:00
junit_properties.py	refactor(e2e): replace bespoke result reporter with standard JUnit report (#33758)	2026-07-17 20:53:22 +00:00
lifecycle.py	test(e2e): cover key max_budget blocks on personal, team, and team-member keys (#33895)	2026-07-22 17:48:18 -07:00
models.py	test(e2e): replay a real tool-search assistant turn back to Bedrock Invoke (#36856)	2026-08-17 11:59:26 -07:00
otel_client.py	test(e2e): add Other suite and Guardrails coverage incl. an MCP tool-call guardrail (#34149)	2026-07-21 14:06:29 -07:00
proxy_client.py	feat(e2e): add record/replay transport seam and fixture bundle format	2026-08-18 14:08:00 -07:00
pytest.ini	test(e2e): add weekly session-anomaly load test against real providers	2026-07-21 14:54:02 -07:00
test_e2e_http.py	test(e2e): retry provider-transient statuses at the transport with bounded backoff (#35824)	2026-08-04 14:57:42 -07:00
test_fixture_bundle.py	feat(e2e): add record/replay transport seam and fixture bundle format	2026-08-18 14:08:00 -07:00
test_fixture_canonical.py	feat(e2e): canonical content-based match keys for record-and-replay	2026-08-19 14:33:22 -07:00
test_fixture_transport.py	feat(e2e): canonical content-based match keys for record-and-replay	2026-08-19 14:33:22 -07:00
transport.py	test(e2e): bound the post-/model/new servable wait at 40s	2026-07-28 17:47:19 -07:00