litellm/tests/e2e/claude_code
mateo-berri 3befa3afc3 test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8
Anthropic and both Bedrock surfaces move their mid and large tiers from
claude-sonnet-4-6 / claude-opus-4-7 to claude-sonnet-5 / claude-opus-4-8.
The haiku-4-5 small tier is unchanged everywhere.

Vertex AI stays fully on the old tiers and Azure keeps sonnet-4-6 in its
sonnet slot (opus does bump to 4-8): live validation showed both new base
models 429 with 0 TPM quota in the suite's Vertex project/region, and the
Foundry subscription has a hard 0 TPM quota limit for Claude Sonnet 5, so
a sonnet-5 deployment cannot be created yet. test_v0_layout now encodes
the per-provider tier expectations so the pins are enforced and documented.
2026-07-15 16:47:31 -07:00
..
_builder_unit_tests test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
_driver_unit_tests test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
_pr_gate_unit_tests test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
_publisher_unit_tests test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
basic_messaging_non_streaming test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
basic_messaging_streaming test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
count_tokens test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
cron_vm test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
long_context_1m test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
pdf_input test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
prompt_caching_1h test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
prompt_caching_5m test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
structured_outputs test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
thinking test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
thinking_with_tool_use test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
tool_search test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
tool_use test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
tool_use_streaming test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
vision test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
web_search test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
__init__.py test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
_basic_messaging.py test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
cli_driver.py test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
conftest.py test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
http_probe.py test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
manifest.yaml test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
matrix_builder.py test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
pr_gate_version_resolver.py test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
rate_limiter.py test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
run_compat.sh test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
sample_compatibility-matrix.json test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
test_config.yaml test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00