mirror of
https://github.com/BerriAI/litellm.git
synced 2026-08-28 05:25:59 +00:00
53c9d48bd2
Adds a scheduled GitHub Actions lane on top of the merged record/replay transport. A Saturday cron records the `replayable` e2e tests against the real providers and publishes the fixture bundle as a private `e2e-fixtures-bundle` artifact with a SHA-256 sidecar. Weekday crons pull that artifact by its pinned digest, verify the checksum before extracting, and replay it with provider credentials set to bogus values, so a run that ever reached a real provider fails instead of passing. An egress sentinel pins the provider hostnames to a local sink for the whole replay job and counts every connection that reaches them; the job asserts that count is zero, so hermeticity is proven by measurement. A red Saturday publishes no bundle, so the next weekday finds nothing fresh and fails loudly rather than replaying a week-old recording, and the transport's seven-day freshness gate hard-fails any bundle that has drifted too far. The lane also runs on demand from the Actions tab with a record/replay `mode` input. Tests join the lane with `@pytest.mark.replayable`. The streaming Anthropic test now counts to twenty so its recorded response banks several content deltas, matching the assertion that the stream arrives incrementally. |
||
|---|---|---|
| .. | ||
| _agent_shin_actions.py | ||
| agent_shin_shared.py | ||
| assert_ci_coverage.py | ||
| assert_workflow_dir_hygiene.py | ||
| auto_update_price_and_context_window_file.py | ||
| close_duplicate_issues.py | ||
| close_low_quality_prs.py | ||
| detect_changes.sh | ||
| e2e_egress_sentinel.py | ||
| e2e_fetch_fixture_bundle.sh | ||
| e2e_pack_fixture_bundle.sh | ||
| run_llm_translation_tests.py | ||
| scan_keywords.py | ||
| select_ui_test_scope.sh | ||
| triage-requirements.txt | ||
| triage_with_llm.py | ||
| uv_sync_with_retries.sh | ||