devin-ai-integration[bot] d46304900f fix(router): stream /v1/messages lifecycle frames live when no fallback can take over (#43600) ... * fix(router): stream anthropic messages lifecycle frames live when no fallback can take over The /v1/messages streaming wrapper buffered message_start and content_block_start until the first content_block_delta and dropped pings behind buffered frames unconditionally, even for requests no fallback could ever recover. With adaptive thinking on Bedrock or Vertex the client saw no bytes for the whole thinking pass and hit read timeouts. Buffering now applies only while a fallback can still take over (generic or refusal chain resolving), and a ping is always forwarded live since it carries no lifecycle and keeps the connection alive. Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(router): mirror every dispatcher fallback path in the anthropic stream gate Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(router): skip already-tried order levels in the anthropic stream gate Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(router): keep a transport-split ping behind buffered lifecycle frames instead of forwarding its head live Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * chore(router): credit the #39566 branch this fix supersedes Co-authored-by: Radu Swigler <radu.porumba@gmail.com> Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: mateo <mateo@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: yassin <yassin@berri.ai> Co-authored-by: Radu Swigler <radu.porumba@gmail.com>		2026-09-29 09:22:05 -07:00
..
a2a	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
aiml	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
anthropic	fix(router): stream /v1/messages lifecycle frames live when no fallback can take over (#43600)	2026-09-29 09:22:05 -07:00
apiserpent	test(unit): add package markers to migrated unit test directories	2026-09-20 11:53:14 +00:00
azure	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
azure_ai	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
base_llm	feat(sail): add Sail as a provider with service_tier mapped to its completion window (#42840)	2026-09-26 12:57:48 -07:00
baseten	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
bedrock	fix(params): validate stream_chunk_size once, before any provider call (#43222)	2026-09-26 23:01:20 +00:00
bedrock_mantle	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
black_forest_labs	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
bytez	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
cerebras	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
chat	fix(params): validate stream_chunk_size once, before any provider call (#43222)	2026-09-26 23:01:20 +00:00
chatgpt	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
cloudflare	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
cohere	refactor(ocr): remove the Python OCR execution path and require the Rust route (#43081)	2026-09-24 18:18:50 -07:00
cometapi	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
compactifai	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
crusoe	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
custom_httpx	test(unit): stop test modules from putting their own directory on sys.path (#43421)	2026-09-28 12:20:20 -07:00
dashscope	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
databricks	fix(cost-map): registry audit 2026-09-26, MAI-Image-2.5-Flash price, Databricks Claude Opus 5.5, Azure Foundry retirement dates (#43254)	2026-09-26 08:34:30 -07:00
datarobot	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
deepgram	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
deepinfra	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
deepseek	refactor(anthropic): rename experimental_pass_through to pass_through (#43329)	2026-09-26 13:00:50 -07:00
docker_model_runner	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
edenai	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
elevenlabs	fix(params): keep _litellm_* kwargs out of provider request bodies by construction (#43221)	2026-09-26 15:20:09 -07:00
fal_ai	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
fastcrw	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
featherless_ai	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
fireworks_ai	feat(fireworks_ai): route and list the auto, auto-instant and firerouter routers (#43641)	2026-09-28 19:08:16 -07:00
gdc	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
gemini	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
gigachat	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
github_copilot	refactor(anthropic): rename experimental_pass_through to pass_through (#43329)	2026-09-26 13:00:50 -07:00
gradient_ai	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
groq	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
heroku	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
hosted_vllm	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
huggingface	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
inception	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
jina_ai	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
langflow	fix(ci): stop stale CI reds, keep unit tests off the host env, retry CyberArk policy conflicts (#43294)	2026-09-26 09:25:13 -07:00
lemonade	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
litellm_proxy	fix(spend): attribute CLI session spend to the per-user cli-session alias instead of the hashed session token (#40541)	2026-09-24 18:21:47 -07:00
llamafile	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
lm_studio	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
manus	test: migrate phase 9 legacy llm provider tests to tests/unit	2026-09-20 08:13:11 +00:00
meta	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
meta_llama	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
minimax	test: migrate phase 9 legacy llm provider tests to tests/unit	2026-09-20 08:13:11 +00:00
mistral	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
modelscope	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
mongodb	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
moonshot	chore(cost-map): remove models past their deprecation date (#42435)	2026-09-22 21:19:26 +00:00
nadir	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
nebius	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
neosantara	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
nimble	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
novita	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
nscale	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
nvidia_nim	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
nvidia_riva	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
oci	fix(params): validate stream_chunk_size once, before any provider call (#43222)	2026-09-26 23:01:20 +00:00
ocr	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
ollama	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
oobabooga	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
openai	fix(openai): exclude fine-tuned and custom gpt-5-chat aliases from gpt-5 reasoning path (#43185)	2026-09-26 16:09:09 -07:00
openai_like	feat(providers): add Prism provider (internal copy of #40914) (#41961)	2026-09-28 16:07:09 -07:00
openrouter	Merge remote-tracking branch 'origin/main' into litellm_migrate_tests_p12	2026-09-20 13:44:19 +00:00
ovhcloud	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
parallel_ai	test: add __init__.py to phase 12 unit test directories	2026-09-20 12:36:15 +00:00
parasail	test: add __init__.py to phase 12 unit test directories	2026-09-20 12:36:15 +00:00
pass_through	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
perplexity	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
pg_vector	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
publicai	test: add __init__.py to phase 12 unit test directories	2026-09-20 12:36:15 +00:00
ragflow	test: add __init__.py to intermediate phase 12 unit test directories	2026-09-20 12:37:21 +00:00
recraft	test: add __init__.py to intermediate phase 12 unit test directories	2026-09-20 12:37:21 +00:00
reducto	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
runwayml	test: add __init__.py to phase 12 unit test directories	2026-09-20 12:36:15 +00:00
s3_vectors	test: add __init__.py to intermediate phase 12 unit test directories	2026-09-20 12:37:21 +00:00
sagemaker	fix(params): validate stream_chunk_size once, before any provider call (#43222)	2026-09-26 23:01:20 +00:00
sail	feat(sail): add Sail as a provider with service_tier mapped to its completion window (#42840)	2026-09-26 12:57:48 -07:00
sambanova	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
sap	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
scaleway	test: add __init__.py to phase 12 unit test directories	2026-09-20 12:36:15 +00:00
snowflake	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
soniox	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
stability	test: add __init__.py to intermediate phase 12 unit test directories	2026-09-20 12:37:21 +00:00
tencent	refactor(anthropic): rename experimental_pass_through to pass_through (#43329)	2026-09-26 13:00:50 -07:00
tinyfish	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
together_ai	test: migrate legacy provider tests to tests/unit (wave 2, phase 13)	2026-09-20 14:18:49 +00:00
valkey	test: migrate legacy provider tests to tests/unit (wave 2, phase 13)	2026-09-20 14:18:49 +00:00
vercel_ai_gateway	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
vertex_ai	fix(vertex_ai): forward the per-turn-control beta for per-message output_config (#43558)	2026-09-28 21:35:08 -07:00
volcengine	test: stop CI tests from downloading tokenizer files and images (#43257)	2026-09-25 19:27:48 -07:00
voyage	test: add __init__.py to every tests/unit directory this migration touches	2026-09-20 11:52:09 +00:00
wandb	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
watsonx	test: add __init__.py to every tests/unit directory this migration touches	2026-09-20 11:52:09 +00:00
xai	feat(xai): add native xAI batches and files support (#42812)	2026-09-25 15:35:20 -07:00
you_com	test: migrate phase 14 wave 2 provider tests to tests/unit	2026-09-20 11:01:40 +00:00
zai	test: add __init__.py to every tests/unit directory this migration touches	2026-09-20 11:52:09 +00:00
__init__.py	test(unit): add package markers to migrated unit test directories	2026-09-20 11:53:14 +00:00
test_cache_control_and_reasoning.py	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
test_file_content_block.py	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
test_file_search_responses.py	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
test_lifecycle_fix.py	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
test_polling_url_origin_match.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_predibase_transformation.py	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00