mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-06 07:48:06 +00:00
f357872c98
* test(integration): stop the wire peer from dropping requests whose bytes arrive late The scripted wire peer set a fixed 5 s socket timeout, so a request whose bytes reached it late on a loaded rig was dropped with no reply and the proxy answered 500 Server disconnected. Remove the timeout and, at teardown, stop reading on every accepted connection so idle handlers exit at once. A request still arriving when teardown starts never reaches the test's respond callback. * fix(tests): bound wire peer teardown on unread replies and answer complete requests * fix(tests): poll wire peer reads so teardown keeps queued requests and only cuts stuck calls * fix(tests): write wire peer replies in pieces so teardown never cuts a client still reading * fix(tests): give a wire peer reply the whole teardown grace when its write blocked before teardown --------- Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_budget.py | ||
| test_client.py | ||
| test_database_relay.py | ||
| test_ordering.py | ||
| test_process.py | ||
| test_routing.py | ||
| test_sdk_models.py | ||
| test_sharding.py | ||
| test_timing.py | ||
| test_translation.py | ||
| test_upstream.py | ||
| test_wire.py | ||
| test_workers.py | ||