scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-10 03:28:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 84
litellm/tests/e2e/claude_code
History
Exact
ryan-crabbe-berri 048a1500df
test(e2e): move the harness self-tests out of tests/e2e (#45172) 
* test(e2e): move the harness self-tests out of tests/e2e

The nightly Buildkite run copies tests/e2e into the runner image and runs
bare pytest, so the 672 tests of the harness itself (fixture parsing, JUnit
properties, the stack lock, the load aggregators, the Claude Code driver)
counted as e2e tests on the status page even though none of them reaches a
proxy. They now live in tests/e2e_harness, mirroring the tests/e2e layout,
and run in the GitHub Actions lint job and the CircleCI
provider_replay_harness job instead

* fix(ci): point the providers replay controls at tests/e2e_harness

The providers integration job still selected the four replay-control
tests under tests/e2e/test_provider_edge.py, so pytest exited before
they ran. The raw-HTTP check's file walk also drops to one loop per
comprehension

* style(tests): mark the raw-HTTP check's bindings Final
2026-10-07 22:20:02 +00:00
..
basic_messaging_non_streaming test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
basic_messaging_streaming test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
count_tokens test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
cron_vm test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
long_context_1m test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
passthrough test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
pdf_input test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
prompt_caching_1h test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
prompt_caching_5m test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
structured_outputs test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
thinking test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
thinking_with_tool_use test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
tool_search test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
tool_use test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
tool_use_streaming test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
vision test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
web_search test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
__init__.py test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
_basic_messaging.py test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
_compat_models.py fix(e2e/claude_code): unblock stage collection, align proxy env names, register compat models (#33433) 2026-07-16 11:05:31 -07:00
_env.py feat(e2e): read management routes back from the control plane replicas (#43373) 2026-09-26 18:05:55 -07:00
_gpt_cells.py test(e2e): skip flaky OpenAI GPT cells; raise multi-window max_tokens (#33799) 2026-07-17 19:07:18 -07:00
_passthrough.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
cli_driver.py test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
conftest.py test(e2e): move the harness self-tests out of tests/e2e (#45172) 2026-10-07 22:20:02 +00:00
http_probe.py test(e2e): tag claude_code cells with Subject metadata and record CLI driver steps (#44961) 2026-10-07 10:31:54 -07:00
manifest.yaml Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_claude_code_e2e_gpt_big3 2026-07-16 15:04:08 -07:00
matrix_builder.py chore(e2e): port the compat-matrix cron publisher to tests/e2e/claude_code 2026-08-10 21:46:56 +00:00
pr_gate_version_resolver.py fix(e2e): skip unpublished npm versions in the Claude Code PR-gate resolver (#43053) 2026-09-24 15:17:31 -07:00
rate_limiter.py test(e2e/claude_code): add GPT-5.6 Sol/Terra/Luna provider columns for OpenAI, Azure OpenAI, and Bedrock Mantle 2026-07-15 16:25:32 -07:00
run_compat.sh fix(security): remove the publicly known master key from the repo (#44718) 2026-10-06 10:55:24 -07:00
sample_compatibility-matrix.json test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
test_config.yaml test(e2e/claude_code): reuse AZURE_API_BASE/KEY for the azure_openai GPT column 2026-07-16 16:45:18 -07:00