scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-14 23:21:35 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 102
litellm/tests/e2e
History
Exact
mateo-berri 3befa3afc3 test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 
Anthropic and both Bedrock surfaces move their mid and large tiers from
claude-sonnet-4-6 / claude-opus-4-7 to claude-sonnet-5 / claude-opus-4-8.
The haiku-4-5 small tier is unchanged everywhere.

Vertex AI stays fully on the old tiers and Azure keeps sonnet-4-6 in its
sonnet slot (opus does bump to 4-8): live validation showed both new base
models 429 with 0 TPM quota in the suite's Vertex project/region, and the
Foundry subscription has a hard 0 TPM quota limit for Claude Sonnet 5, so
a sonnet-5 deployment cannot be created yet. test_v0_layout now encodes
the per-provider tier expectations so the pins are enforced and documented.
2026-07-15 16:47:31 -07:00
..
access_control test(e2e): migrate access-control and inference-endpoint regression tests (#32016) 2026-07-05 01:39:10 +00:00
batches fix(e2e): bound spend-log snapshots to a /spend/logs/v2 window (#33265) 2026-07-14 13:32:10 -07:00
claude_code test(e2e): bump claude code compat matrix tiers to sonnet-5 and opus-4-8 2026-07-15 16:47:31 -07:00
coverage_registry test(e2e): otel trace completeness on streaming chat, messages, and responses (LIT-3787) (#33234) 2026-07-14 20:23:54 -07:00
llm_translation test(e2e): scope virtual keys to the deployment under test 2026-07-14 17:12:15 -07:00
logging test(e2e): failed request error span carries the full untruncated message and status (LIT-4179) (#33304) 2026-07-14 22:13:13 -07:00
management test(e2e): cover key rpm/tpm rate limiting, window reset, and pacing headers 2026-07-11 16:15:16 -07:00
quota_management refactor: make the code easier to read 2026-07-14 13:58:23 -07:00
bob_the_builder.py test: litellm fix failing tests (#32577) 2026-07-09 13:54:45 -07:00
CLAUDE.md test(claude_code): move the Claude Code compatibility matrix under tests/e2e (#32548) 2026-07-14 19:19:03 -07:00
conftest.py refactor(e2e): move budgets and spend_tracking suites under quota_management 2026-07-11 16:14:21 -07:00
CONTRIBUTING.md ci: gate tests/e2e on zero basedpyright errors in pre-commit and lint CI 2026-07-11 10:25:22 -07:00
docker-compose.yml test(e2e): failed request error span carries the full untruncated message and status (LIT-4179) (#33304) 2026-07-14 22:13:13 -07:00
e2e_config.py test(e2e): otel trace completeness on /v1/messages (#33133) 2026-07-13 20:19:06 -07:00
e2e_gateway.py fix(e2e): bound spend-log snapshots to a /spend/logs/v2 window (#33265) 2026-07-14 13:32:10 -07:00
e2e_http.py test(e2e): otel trace completeness on streaming chat, messages, and responses (LIT-3787) (#33234) 2026-07-14 20:23:54 -07:00
lifecycle.py test(e2e): add live batches suite across providers and routing scenarios (#30958) 2026-07-02 08:05:23 -07:00
models.py test(e2e): otel trace completeness on streaming chat, messages, and responses (LIT-3787) (#33234) 2026-07-14 20:23:54 -07:00
pytest.ini refactor(e2e): move budgets and spend_tracking suites under quota_management 2026-07-11 16:14:21 -07:00
test_e2e_gateway.py fix(e2e): bound spend-log snapshots to a /spend/logs/v2 window (#33265) 2026-07-14 13:32:10 -07:00
test_lifecycle.py test: add e2e tests for spend, budgets and llms (#30869) 2026-06-24 15:01:57 -07:00
test_transport.py test(e2e): probe the full spend read surface including schema-hidden routes (#32267) 2026-07-06 14:02:05 -07:00
transport.py test(e2e): probe the full spend read surface including schema-hidden routes (#32267) 2026-07-06 14:02:05 -07:00