mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-06 08:16:43 +00:00
98765f65af
* feat(e2e): emit structured E2E_RESULT lines for package status history Pytest progress logs only expose file basenames and collapse multi-test files into one status-history row. Emit one logfmt E2E_RESULT per finished node with package, file, outcome, duration_ms, node_id, and covers so Grafana can roll up by package (stable cardinality) and drill down by node_id in Explore * test(e2e): drop unit tests from the live e2e tree tests/e2e is for live proxy suites only. Remove harness, coverage-registry, and claude_code unit trees so the e2e run does not collect them * fix(e2e): type E2E_RESULT hook for basedpyright zero-error gate Protocol-typed covers extraction and pluggy Result typing on the makereport hook so tests/e2e stays under the e2e basedpyright ceiling * fix(e2e): drop unused xfailed/xpassed from E2E_RESULT Outcome We never emit those states; xfail collapses to skipped/passed via pytest report flags. Keep the literal honest so the dashboard only sees real outcomes * fix(e2e): strip tests/e2e prefix when deriving E2E_RESULT package Repo-root pytest nodeids are tests/e2e/<suite>/...; without stripping, every line would package=tests and status history would be useless * fix(e2e): use pytest wrapper=True instead of deprecated hookwrapper pytest 8.1+ deprecates hookwrapper; yield returns the TestReport directly so we return it for the outer chain and drop pluggy.Result * fix(e2e): import e2e_result_reporter at module load Surface a missing module as a collection-time ImportError instead of a per-test hook failure mid-run * test(e2e): restore coverage_registry/test_collector.py Needed to validate registry coverage math and the checked-in cell denominator; not a live proxy suite |
||
|---|---|---|
| .. | ||
| basic_messaging_non_streaming | ||
| basic_messaging_streaming | ||
| count_tokens | ||
| long_context_1m | ||
| passthrough | ||
| pdf_input | ||
| prompt_caching_1h | ||
| prompt_caching_5m | ||
| structured_outputs | ||
| thinking | ||
| thinking_with_tool_use | ||
| tool_search | ||
| tool_use | ||
| tool_use_streaming | ||
| vision | ||
| web_search | ||
| __init__.py | ||
| _basic_messaging.py | ||
| _compat_models.py | ||
| _env.py | ||
| _passthrough.py | ||
| cli_driver.py | ||
| conftest.py | ||
| http_probe.py | ||
| manifest.yaml | ||
| matrix_builder.py | ||
| pr_gate_version_resolver.py | ||
| rate_limiter.py | ||
| run_compat.sh | ||
| sample_compatibility-matrix.json | ||
| test_config.yaml | ||