litellm/docs
Julio Quinteros Pro feb01b9599 docs: add comprehensive test flakiness solutions guide
Add two detailed guides for addressing CI test flakiness:

1. test-flakiness-guide.md - Developer guide with:
   - How to use @pytest.mark.no_parallel for async mocks
   - Patterns for robust async mock setup
   - Retry logic strategies
   - Module reload issues and fixes
   - Quick reference and checklist

2. ci-test-improvements.md - Implementation plan with:
   - Priority phased rollout (Quick wins → CI → Enforcement)
   - pytest-rerunfailures plugin setup
   - GitHub Actions improvements for retries
   - Makefile targets for testing
   - Pre-commit hooks for test quality
   - Test utilities module with decorators
   - Success metrics and monitoring

These guides provide actionable solutions for the CI test failures
observed in PRs #21107, #21388, and #21390.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
2026-02-17 14:44:43 -03:00
..
my-website Merge pull request #20321 from Harshit28j/litellm_fix-virtual-key-grace-period 2026-02-16 19:36:18 +05:30
ci-test-improvements.md docs: add comprehensive test flakiness solutions guide 2026-02-17 14:44:43 -03:00
test-flakiness-guide.md docs: add comprehensive test flakiness solutions guide 2026-02-17 14:44:43 -03:00