litellm/tests/e2e/claude_code
Yuneng Jiang c63d0e6922
fix(e2e): bind provider-cache recordings to the deployment's test, not the serving process
The cache edge keyed every recording on its own process's PYTEST_CURRENT_TEST.
Under xdist that names whatever test the serving worker is in, which is
unrelated to the caller: the proxy is a separate pod, and the Claude Code compat
matrix registered its shared aliases from every worker, each pointing at that
worker's edge, so the router spread one worker's calls across all eight edges.
Builds 234 and 235 of litellm-e2e, same commit, credited the same Bedrock
request to unrelated tests 92% of the time, and Bedrock never converged past a
~20% hit rate while OpenAI, whose deployments are per test, sat at 90%.

A deployment registered from inside a test now carries its test's slug in the
edge URL it is pointed at, `{edge}/{mount}/t/{slug}`, and the edge reads that
segment off every request before forwarding. A request without one is forwarded
live and never cached, and the edge no longer falls back to process state. The
compat aliases are registered with provider_live=True and stay on their real
provider path: no single test owns them, and the matrix exists to prove the real
CLI against real providers.
2026-09-16 17:08:17 -07:00
..
_builder_unit_tests
_driver_unit_tests fix(e2e): keep the CLI determinism test out of the in-cluster suite 2026-09-16 16:01:32 -07:00
_probe_unit_tests test(e2e): replay a real tool-search assistant turn back to Bedrock Invoke (#36856) 2026-08-17 11:59:26 -07:00
basic_messaging_non_streaming
basic_messaging_streaming
count_tokens
cron_vm
long_context_1m
passthrough
pdf_input
prompt_caching_1h
prompt_caching_5m
structured_outputs
thinking
thinking_with_tool_use
tool_search test(e2e): replay a real tool-search assistant turn back to Bedrock Invoke (#36856) 2026-08-17 11:59:26 -07:00
tool_use
tool_use_streaming
vision
web_search
__init__.py
_basic_messaging.py
_compat_models.py
_env.py fix(e2e): wait for every gateway before using a new model and keep the network rerun 2026-09-05 16:10:40 -07:00
_gpt_cells.py
_passthrough.py
cli_driver.py fix(e2e): stage the seeded device id per thread, not per process 2026-09-16 13:47:07 -07:00
conftest.py fix(e2e): bind provider-cache recordings to the deployment's test, not the serving process 2026-09-16 17:08:17 -07:00
http_probe.py test(e2e): replay a real tool-search assistant turn back to Bedrock Invoke (#36856) 2026-08-17 11:59:26 -07:00
manifest.yaml
matrix_builder.py
pr_gate_version_resolver.py
rate_limiter.py
run_compat.sh
sample_compatibility-matrix.json
test_config.yaml