mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-29 06:33:28 +00:00
The 48 MB budget on the third batch kept failing on the x86 release gate with no leak behind it. Isolated rc/1.107.0 and v1.105.1 stacks both grew about 60 MB on the third batch with gc-tracked objects flat, and both levelled off to a couple of MB per batch after twenty batches. Measure batches 3-4 against a 200 MB per-worker ceiling instead, which a native leak of 400 KB per failed request still trips. The stored-request size check stays the deterministic catch for the v1.100.0 leak |
||
|---|---|---|
| .. | ||
| complexity_router_client.py | ||
| conftest.py | ||
| reliability_support.py | ||
| test_auto_router_regressions_e2e.py | ||
| test_complexity_router_e2e.py | ||
| test_reliability_cache_e2e.py | ||
| test_reliability_cancel_on_disconnect_e2e.py | ||
| test_reliability_cooldowns_e2e.py | ||
| test_reliability_fallbacks_e2e.py | ||
| test_reliability_memory_e2e.py | ||
| test_reliability_prompt_caching_e2e.py | ||
| test_reliability_retries_e2e.py | ||
| test_reliability_routing_strategies_e2e.py | ||
| test_reliability_timeouts_e2e.py | ||