devin-ai-integration[bot] 47bba14336 fix(passthrough): parse Bedrock stream spend incrementally instead of buffering the whole response (#40724) ... * fix(passthrough): parse Bedrock stream spend incrementally instead of buffering the whole response Bedrock pass-through streaming kept every relayed chunk in memory until EOF and then decoded, parsed and translated the whole stream again for spend logging. Large or concurrent streams could exhaust proxy worker memory. Sync and async passthrough wrappers now hand each chunk to a provider stream collector as it is relayed. Bedrock decodes event-stream frames incrementally, folds consecutive text deltas, and keeps only what stream_chunk_builder needs for usage, tool calls and metadata. Text deltas are no longer retained in the Bedrock and Anthropic stream decoders either. Providers without a collector keep the previous raw-bytes behavior. Collector failures are isolated so spend tracking can never interrupt the customer stream Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(passthrough): assert the spend payload the collector builds instead of mock internals Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(passthrough): type the Bedrock collector helpers by the collector protocol instead of asserting the class Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: yassin <yassin@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-09-11 09:53:37 -07:00
..
__init__.py	fix(passthrough): propagate Azure 429/5xx errors in async streaming instead of silent HTTP 200 (#22913)	2026-03-05 10:12:43 -08:00
test_async_streaming_error_propagation.py	fix(passthrough): keep upstream error body readable for streaming error status mapping	2026-08-30 12:59:18 -07:00
test_passthrough_main.py	fix(azure_ai): add passthrough config so router-model relays reach the deployment's own endpoint	2026-09-04 21:30:48 -07:00
test_streaming_interrupt_spend_tracking.py	fix(passthrough): parse Bedrock stream spend incrementally instead of buffering the whole response (#40724)	2026-09-11 09:53:37 -07:00