yucheng-berri efc2304b7e fix(streaming)!: fail a stream that ends without a finish reason (#47665) ... * fix(streaming): fail on clean EOF without finish reason * fix(streaming): cover shared OpenAI-compatible EOF paths * test(router): complete mocked streaming responses * fix(streaming): keep the EOF error message and cover Anthropic clean EOF The request-less RemoteProtocolError tripped exception mapping into 'The .request property has not been set.' for non-OpenAI providers. Adds Anthropic and generic-chunk unit tests, an integration test across chat, the /v1/messages bridge and the /v1/responses bridge, and moves main's token-estimate test onto a finished stream with a sibling that checks the cut stream still bills the estimate on its failure log. * fix(streaming): count a finish reason any chunk sent, keep LangGraph async streams whole Gemini marks every chunk unfinished and a later usage chunk reset intermittent_finish_reason, so a finished Gemini stream failed at EOF. LangGraph's __aiter__ opened a new aiter_lines on every wrapper call, which hit StreamConsumed after the first chunk and now surfaced as a false EOF error instead of a silent truncation. * fix(streaming): keep the synthetic stop for a stream that sent no chunks Gemini's OpenAI-compatible endpoint answers with only [DONE] when reasoning uses up max_tokens. Failing every openai/azure stream that sent nothing turned that 200 into a 500, while every other provider already kept the stop for an empty stream. Adds integration cells for Gemini's trailing usage chunk, multi-event LangGraph runs, a mocked deployment and the [DONE]-only answer. * test(streaming): keep pytest.raises to one statement, drop the spend read for an empty stream An empty stream writes no spend row on main either, so the [DONE]-only cell checks only what the client sees. * fix(streaming): read the chunk's finish reason for the sticky flag * fix(agentcore): end a stream on messageStop when the runtime sends no metadata or final message * test(streaming): pin the logged-chunks guard, inject the LangGraph client, use current model names * fix(agentcore): say why the end-of-stream flags rebind * test(streaming): cover an AgentCore runtime that ends on messageStop through the proxy * test(streaming): cover SDK clients, request fallbacks and a concurrent burst for a cut stream * test(agentcore): inject the async transport instead of patching the aiohttp flag * test(guardrails): end the decision model chat fixture with a finish reason, as a real stream does * test(streaming): shape the AgentCore and LangGraph fixtures like captures from a real runtime and server * test(streaming): keep each stream's ending and land every spend row once through a spend log outage * test(streaming): end each stream by its provider's finish after a proxy worker is killed mid burst * test(streaming): run the outage test as one burst before and one during the outage instead of a capped wave loop * test(streaming): connect the outage test's proxy to the relay without TLS so its trigger sees the spend-log insert on an ssl=on Postgres * test(streaming): type the new stream EOF unit tests * test(streaming): a merged reasoning stream cut mid reasoning now fails Main's think tag test expected a stream that ends mid reasoning without a finish reason to finish with a closed think block. With this PR that stream fails, so the case moves to its own test that expects MidStreamFallbackError with the open think block as the partial content --------- Co-authored-by: King Star <mcxin.y@gmail.com> Co-authored-by: yucheng-berri <293926326+yucheng-berri@users.noreply.github.com>		2026-10-31 11:29:26 -07:00
..
audio_utils	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
llm_cost_calc	fix(vertex_ai): bill Claude web search per request on deployments priced in model_info (#49160)	2026-10-30 23:14:51 -07:00
llm_response_utils	fix(streaming): normalize stop after OpenAI-compatible tool calls (#49388)	2026-10-31 10:33:56 -07:00
prompt_templates	fix(router): inspect image content without translating routed requests (#49371)	2026-10-31 10:44:24 -07:00
specialty_caches	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
__init__.py	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
attribute_forwarder.py	refactor(typing): clear 1181 basedpyright Any errors across 431 files (#47789)	2026-10-24 11:31:09 -07:00
conftest.py	test(ci): repair stale tests and flaky CI infrastructure (#43983)	2026-10-01 17:46:43 +00:00
event_loop_lag.py	test: repair stale and polluting tests red on scheduled main CI (#44229)	2026-10-02 21:32:17 +00:00
fake_secret_vault.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
messages_with_counts.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_agentic_followup_kwargs.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_anthropic_dedup_factory.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_api_route_to_call_types.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_app_crypto.py	test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554)	2026-10-09 09:48:10 -07:00
test_audio_utils.py	fix(proxy): account for media in combined TPM reservations (#48865)	2026-10-28 12:39:41 -07:00
test_aws_partition.py	perf(ci): isolate and shard integration suites (#44146)	2026-10-10 11:15:19 -07:00
test_batch_utils.py	refactor(router): fence the router surface and document the router-core boundary (#48839)	2026-10-29 00:01:52 +00:00
test_bedrock_converse_dedup_factory.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_bug_report.py	fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported (#46344)	2026-10-16 00:53:52 +00:00
test_chat_completion_agentic_loop.py	fix(websearch)!: keep the provider prefix on the agentic follow-up model (#38885)	2026-10-29 04:47:18 -07:00
test_classifier_logging.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_cli_token_utils.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_cloud_storage_security.py	fix(proxy)!: let proxy admin keys read raw cloud storage file ids on GET /files/{id}/content (#40621)	2026-10-20 10:58:42 +00:00
test_codestral_provider_routing.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_core_helpers.py	fix(anthropic): map pause_turn and return refusal explanations on chat and responses (#49192)	2026-10-31 02:53:59 -07:00
test_coroutine_checker.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_cost_discount.py	feat(cost): support provider/model-pattern keys in cost_discount_config (#43335)	2026-10-12 14:59:18 -07:00
test_custom_logger_registry.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_dd_tracing.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_decisions_pricing.py	feat(decisions): bill decisions and systemone from _decisions cost map fields (#45904)	2026-10-12 14:31:12 -07:00
test_decode_special_tokens.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_default_encoding.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_dot_notation_indexing.py	refactor(typing): widen delete_nested_value to Mapping and drop two unused Span aliases (#48001)	2026-10-24 19:39:27 +00:00
test_duration_parser.py	feat(proxy): report when each per-model budget window resets (#45797)	2026-10-15 10:56:45 -07:00
test_env_utils.py	fix(router): cap the default OTPM reservation and reconcile token counters after each call (#49054)	2026-10-29 20:32:04 -07:00
test_error_normalization.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_exception_mapping_utils.py	fix(exceptions): classify SGLang context window overflow (#48837)	2026-10-30 13:46:37 -07:00
test_extract_base64_image.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_fallback_generalizations.py	refactor(fallback-generalizations)!: remove the legacy extends and mixed-rule shim (#48737)	2026-10-28 05:17:28 -07:00
test_fallback_utils.py	fix(cache_control): pick the chat-path dialect from the deployment's provider prefix (#45295)	2026-10-30 05:11:42 -07:00
test_get_litellm_params.py	fix(chatgpt): derive the upstream session id from prompt_cache_key (#42014)	2026-10-28 10:57:51 -07:00
test_get_llm_provider_endpoint_match.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_get_llm_provider_logic.py	fix(proxy): let typesafe/* allowlists cover /typesafe Jev calls and list Jev in the model picker (#47697)	2026-10-28 20:19:58 -07:00
test_get_model_cost_map.py	feat(proxy): add LITELLM_OFFLINE_MODE, one switch for the fetches LiteLLM makes on its own (#48096)	2026-10-23 16:54:19 -07:00
test_get_supported_openai_params.py	fix(bedrock): backfill published regional service tier prices (#49113)	2026-10-29 19:46:57 -07:00
test_health_check_helpers.py	fix(health): probe only models a partial wildcard serves (#49060)	2026-10-29 23:34:57 -07:00
test_hidden_params.py	perf(streaming): stop raising caught AttributeErrors inside pydantic on every streamed chunk (#49166)	2026-10-30 10:01:44 -07:00
test_image_handling.py	fix(anthropic): send PDF image_url content to Claude as document blocks (#46984)	2026-10-30 02:21:39 -07:00
test_initialize_dynamic_callback_params.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_internal_call_metadata.py	fix(responses): resume background response streams with stream and starting_after (#48819)	2026-10-29 02:31:22 -07:00
test_json_fragment_accumulator.py	test(json_fragment_accumulator): assert peak allocation instead of a drain timing ratio (#43370)	2026-10-28 22:04:47 -07:00
test_json_schema_validation.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_litellm_logging.py	fix(messages): price a native /v1/messages body as served unless its provider reports its own cost (#49356)	2026-10-31 09:52:39 -07:00
test_llm_judge.py	fix(guardrails): resolve decision models in caller team scope (#46085)	2026-10-15 11:43:36 -07:00
test_llm_request_utils.py	fix(aiand)!: show ai&'s name and logo, and sync ai&'s model list (#49158)	2026-10-30 10:55:26 -07:00
test_logging_callback_manager.py	fix(router): unregister strategy selectors from global callbacks on discard (#45795)	2026-10-21 02:39:36 +00:00
test_logging_utils.py	perf(logging): skip the base64 regex on plain text and copy a few large strings inline (#49228)	2026-10-31 01:03:04 -07:00
test_logging_worker.py	fix(proxy): persist tag spend and drain success callbacks within the shutdown budget (#48988)	2026-10-29 09:32:18 -07:00
test_max_streaming_duration.py	fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194)	2026-10-20 21:46:45 -07:00
test_model_param_helper.py	test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554)	2026-10-09 09:48:10 -07:00
test_model_response_utils.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_moderation_standard_logging.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_oauth_token_exchange.py	feat(microsoft_365_copilot): add Microsoft 365 Copilot chat provider with OAuth token exchange (#45158)	2026-10-09 15:19:07 -07:00
test_offline_mode.py	feat(proxy): add LITELLM_OFFLINE_MODE, one switch for the fetches LiteLLM makes on its own (#48096)	2026-10-23 16:54:19 -07:00
test_optional_imports.py	refactor(sdk): separate core AWS and tokenizer dependencies (#44447)	2026-10-08 19:07:57 -07:00
test_path_utils.py	refactor(core): move path_utils from proxy common_utils to litellm_core_utils (#45775)	2026-10-10 19:07:22 +00:00
test_private_json.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_provider_affinity.py	fix(headroom): forward tenant-scoped session affinity (#49255)	2026-10-30 12:32:03 -07:00
test_provider_specific_headers.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_ptu_pricing.py	feat(proxy): split Azure PTU deployments across teams with per-team PTU ceilings and PTU-hour reporting (#43043)	2026-10-15 18:44:30 +00:00
test_realtime_errors.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_realtime_streaming.py	fix(realtime)!: send the Gemini Live setup at the first content so session.update settings apply (#39864)	2026-10-30 01:31:39 -07:00
test_redact_messages.py	fix(vertex_ai,azure_ai)!: auto-add the compaction, thinking display, and tool change betas on Claude routes (#44747)	2026-10-30 09:28:19 -07:00
test_request_timeout_resolver.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_retry_after_headers.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_safe_divide_seconds.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_safe_json_dumps.py	fix(spend): keep a NaN or infinite cost from wedging daily spend writes (#48829)	2026-10-30 08:27:35 -07:00
test_sensitive_data_masker.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_sentry_scrubbing.py	fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported (#46344)	2026-10-16 00:53:52 +00:00
test_served_output_texts.py	fix(guardrails): scan and rewrite streamed /v1/completions under post_call guardrails (#49035)	2026-10-29 08:46:49 -07:00
test_stream_usage_logging.py	test: replace 61 live logging and otel tests with offline unit and integration coverage (#45362)	2026-10-08 15:55:57 -07:00
test_streaming_chunk_builder_cursor.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_streaming_chunk_builder_server_tool_use.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_streaming_chunk_builder_utils.py	feat(openrouter): record upstream provider in logging payload and spend logs (#49287)	2026-10-30 12:51:48 -07:00
test_streaming_handler.py	fix(streaming)!: fail a stream that ends without a finish reason (#47665)	2026-10-31 11:29:26 -07:00
test_streaming_overhead.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_text_completion_conversion.py	refactor(types): replace Any with proven types in 14 files (#48928)	2026-10-29 07:26:07 -07:00
test_thread_pool_executor.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_token_counter.py	fix(count_tokens): count a history that carries a compaction block (#44784)	2026-10-30 00:11:55 -07:00
test_token_counter_tool.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_token_counter_tool_data.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_tokenizer.py	fix(token_counter)!: keep a loaded Hugging Face tokenizer when a slower download fails (#48916)	2026-10-29 03:50:58 -07:00
test_tool_fields.py	fix(proxy)!: answer 400 for malformed tools on count_tokens instead of crashing (#46583)	2026-10-16 14:57:53 -07:00
test_tool_search_spend_logging.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
test_url_utils.py	fix(llms): join api_base and route with one shared helper (#47535)	2026-10-21 06:59:32 +00:00
test_xai_oauth_routing.py	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00