Kerry Lu 339fd90836 fix(proxy): streaming responses hand the event loop back every 50 ms instead of holding it for the whole buffered stream (#46925) ... * fix(proxy): streaming responses hand the event loop back every 50 ms instead of holding it for the whole buffered stream * fix(proxy): yield to the event loop on every streamed chunk, no hold budget or clock * docs(proxy): say why the streaming loop yields on every chunk * fix(proxy): streaming loop yields once it has held the event loop 50 ms, clock read inline * docs(proxy): streaming loop comment names the 50 ms hold * Revert "docs(proxy): streaming loop comment names the 50 ms hold" This reverts commit cbf1371873. * refactor(proxy): streaming loop hold budget is _STREAM_LOOP_HOLD_MS = 50 * Revert "refactor(proxy): streaming loop hold budget is _STREAM_LOOP_HOLD_MS = 50" This reverts commit 356454def6. * docs(proxy): streaming loop comment notes the yield is a floor, not a count of releases --------- Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-10-16 11:33:01 -07:00
..
.coverage_baseline
__init__.py
_coverage_check.py
_pin_check.py
conftest.py
test_background_health.py
test_exception_handlers.py
test_harness_smoke.py
test_lifecycle.py	fix(proxy): track and drain management audit log writes on shutdown (#43594)	2026-10-16 08:41:34 +00:00
test_openapi_customization.py
test_proxy_config.py	fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported (#46344)	2026-10-16 00:53:52 +00:00
test_routes_anthropic_beta.py
test_routes_assistants.py
test_routes_audio.py
test_routes_chat_completions.py
test_routes_completions.py
test_routes_config.py	fix(proxy)!: delete callbacks configured under callbacks or failure_callback (#42740)	2026-10-16 09:22:22 -07:00
test_routes_embeddings.py
test_routes_invitation.py
test_routes_login_sso.py	test(cost): add tier 1 claude messages stream twins and recapture drifted usage shapes (#46690)	2026-10-15 17:11:13 +00:00
test_routes_misc.py
test_routes_model_cost_map.py
test_routes_model_info.py	fix(proxy): list team access group models in /v1/model/info and keep key model lists narrow (#32599)	2026-10-15 10:23:03 -07:00
test_routes_model_metrics.py
test_routes_models.py
test_routes_moderations.py
test_routes_onboarding.py
test_routes_queue.py
test_routes_threads.py
test_routes_utils.py	fix(proxy)!: count prompt-only token_counter requests with the provider when call_endpoint is set (#46839)	2026-10-16 10:54:42 +00:00
test_spend_counters.py	fix(caching): make Redis Cluster commands wait for a pool slot instead of tripping the circuit breaker (#46488)	2026-10-14 15:27:00 -07:00
test_streaming_helpers.py	fix(proxy): streaming responses hand the event loop back every 50 ms instead of holding it for the whole buffered stream (#46925)	2026-10-16 11:33:01 -07:00
test_team_model_name_translation.py	fix(proxy): resolve model aliases to their target deployment for listing metadata (#41041)	2026-10-15 00:38:50 -07:00