litellm/tests/e2e/claude_code
ryan-crabbe-berri 3af23024bc
test(e2e): share the coding-CLI harness between suites (#49370)
* test(e2e): share the CLI version rule, env lockdown and rate limiter in tests/e2e/cli_harness

Moves the npm release rule (now taking the package name), the env allowlist plus fresh HOME, and the per-upstream rate limiter out of claude_code so the Codex suite can reuse them. Claude Code behavior is unchanged, its CI, cron and Dockerfile paths now call the shared resolver with @anthropic-ai/claude-code

* test(e2e): freeze the packument map and note the rate limiter self-test

* test(e2e): race real processes on one rate limiter bucket so a missing lock fails

Eight spawned processes start together and drain a bucket that never refills. With the flock they get exactly its burst between them, without it every attempt is granted

* test(e2e): keep the old Claude Code version resolver path for the Buildkite runner images

The runner Dockerfiles still run tests/e2e/claude_code/pr_gate_version_resolver.py and silently install @latest when it is missing, which drops the three day review window. The old path now forwards to cli_harness/npm_version_resolver.py
2026-11-02 13:50:56 -08:00
..
basic_messaging_non_streaming test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
basic_messaging_streaming test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
count_tokens test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
cron_vm test(e2e): share the coding-CLI harness between suites (#49370) 2026-11-02 13:50:56 -08:00
long_context_1m test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
passthrough test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
pdf_input test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
prompt_caching_1h test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
prompt_caching_5m test: fix stale and flaky tests across CircleCI, GHA and Buildkite (#45530) 2026-10-09 11:40:14 -07:00
structured_outputs test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
thinking test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
thinking_with_tool_use test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
tool_search test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
tool_use test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
tool_use_streaming test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
vision test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
web_search test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
__init__.py
_basic_messaging.py test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
_compat_models.py
_env.py feat(e2e): read management routes back from the control plane replicas (#43373) 2026-09-26 18:05:55 -07:00
_gpt_cells.py
_passthrough.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
cli_driver.py test(e2e): share the coding-CLI harness between suites (#49370) 2026-11-02 13:50:56 -08:00
conftest.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
http_probe.py test(e2e): share the coding-CLI harness between suites (#49370) 2026-11-02 13:50:56 -08:00
manifest.yaml
matrix_builder.py
pr_gate_version_resolver.py test(e2e): share the coding-CLI harness between suites (#49370) 2026-11-02 13:50:56 -08:00
run_compat.sh test(e2e): share the coding-CLI harness between suites (#49370) 2026-11-02 13:50:56 -08:00
sample_compatibility-matrix.json
test_config.yaml