Commit graph

2 commits

Author SHA1 Message Date
mateo-berri
3befa3afc3 test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8
Anthropic and both Bedrock surfaces move their mid and large tiers from
claude-sonnet-4-6 / claude-opus-4-7 to claude-sonnet-5 / claude-opus-4-8.
The haiku-4-5 small tier is unchanged everywhere.

Vertex AI stays fully on the old tiers and Azure keeps sonnet-4-6 in its
sonnet slot (opus does bump to 4-8): live validation showed both new base
models 429 with 0 TPM quota in the suite's Vertex project/region, and the
Foundry subscription has a hard 0 TPM quota limit for Claude Sonnet 5, so
a sonnet-5 deployment cannot be created yet. test_v0_layout now encodes
the per-provider tier expectations so the pins are enforced and documented.
2026-07-15 16:47:31 -07:00
devin-ai-integration[bot]
56f4dbf60a
test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548)
* test(claude_code): move the Claude Code compatibility matrix under tests/e2e

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* ci(claude_code): drop the CircleCI compat PR gate; the matrix runs in the scheduled e2e suite instead

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* ci: restore the upload-coverage job dropped by mistake with the compat gate

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* fix(e2e/claude_code): print rate-limit summary on failed compat runs and fix stale run_daily.sh header comments

* test(claude_code): assert fine-grained tool streaming via input_json_delta instead of an event-count floor

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

---------

Co-authored-by: mateo <mateo@berri.ai>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>
2026-07-14 19:19:03 -07:00