Mateo Wang 820725661e fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194) ... * fix(proxy): keep a retried /v1/messages stream's spend log by logging the superseded attempt as a failure A /v1/messages stream the router retries before any content shares one logging object across both attempts. The superseded attempt's end-of-stream logging ran as a success (a usage-only or placeholder result) and claimed the request's one-shot success log, so the recovered stream's spend row was either missing or written under the superseded attempt's message id. The passthrough logging path now logs an Anthropic stream whose frames carry an `event: error` as a failure with whatever usage the provider reported, the way a dropped stream already does, and the router closes the superseded stream before it opens the retry so that logging is queued first. * fix(proxy): log a provider error frame through an attempt-scoped logging copy The error-frame failure stashed the superseded attempt's usage on the logging object the retry shares, so the retry's success log carried the failed attempt's token counts. The failure now logs through a copy of the logging object with its own model_call_details, and the helper moves into the Anthropic passthrough logging handler so the proxy streaming handler only routes by endpoint type. * fix(proxy): scope the error-frame failure log to streams closed at the frame A stream that ran to its end at the provider's error frame kept logging through the success route before this PR, and the attempt-scoped failure log is now taken only for a stream the router closed at that frame, with the copy made at the close so the retry's deployment never reaches it * fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage A /v1/messages stream dropped after message_start and retried in its model group shares one Logging object across attempts, so the retry's success log inherited the dropped attempt's stashed usage and exception, and a second drop never reached the failure handlers because the first had already marked the object as logged. The dropped attempt now dispatches its failure handlers through an attempt-scoped copy, and the router discards the stashed usage right before it opens the next attempt, on same-group retries and on every fallback hop, so a request that runs out of attempts still bills the last attempt's partial usage. * fix(router): dispatch chat stream failures through the attempt-scoped logging copy The router now clears a dropped attempt's stashed usage before every fallback hop, so the chat stream wrapper's queued failure log must read that usage from its own copy of the logging object, like the /v1/messages path already does. The stash test asserts through a real success log, the cooldown test reads a real Router's cooldown list, and the integration helpers carry full types. * test(vertex): give the stream wrapper's logging stub an attempt_scoped_copy * test: route the pass-through logging mock's attempt copy to itself and read the callback sink through a reader The pass-through failure test stubbed dispatch_failure_handlers on a spec'd MagicMock, which the attempt-scoped copy no longer reached, so the logging worker never finished. The integration tests kept earlier sink batches in a caller-owned list the helper mutated; a small reader keeps them instead. * test(router): use real Logging in fallback cooldown test Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(router): preserve superseded retry usage for billing Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): bill retry input after prior stream usage Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): track retry dispatch for terminal billing Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(router): use deterministic retry timestamp Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(router): avoid real clock in fallback tests Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(tests): remove duplicate streaming logger import Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(proxy): retain error-frame usage for exhausted retries * test(proxy): fix retry billing expectations and helper annotations * fix(proxy): preserve failure estimate without carried usage Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(proxy): audit retry helpers and fixtures Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): fix retry fixture timestamps Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): observe retry stash at attempt boundary Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(logging): keep terminal failure attribution when dropped attempts log on copies Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(logging): publish a dropped attempt's payload only while it is still the current attempt Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): cover spend-log encoding error propagation Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(anthropic): skip adapter failure dispatch when the wrapped stream already logged it Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(router): cool down the final fallback attempt when its failure callbacks were blocked Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(anthropic): import Final in adapter regression Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): drop spend-log encoding expectation superseded by main's poison isolation Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(anthropic): finish the wrapped stream's failure log before surfacing the error Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(anthropic): wait for the wrapped stream's failure log to finish like the inline dispatch did Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(anthropic): wait for the executor-run sync failure callback separately from the async caller boundary Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(proxy): pin pass-through stream fixture start times Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(logging): publish failed attempt payload before awaiting failure callbacks Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(logging): publish failed attempt payload from the failure handler after baseline invalidation Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(logging): drop unused discard_partial_usage_for_failure Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>		2026-10-20 21:46:45 -07:00
..
a2a_protocol	fix(langfuse_otel)!: send the completion start time (#45597)	2026-10-20 13:52:26 +00:00
anthropic_interface	fix(proxy): send a real error event when a /v1/messages stream fails (#41826)	2026-09-25 15:36:35 -07:00
batch_completion	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
batches	fix(batches): apply the Vertex regional endpoint uplift to batch cost (#47466)	2026-10-20 01:51:51 +00:00
caching	fix(token_counter): stop re-downloading a HuggingFace tokenizer after a failed download (#47586)	2026-10-20 18:24:22 -07:00
completion_extras	fix(router)!: stop a chat-mode Mantle deployment from rewriting the shared Responses routing row (#46263)	2026-10-17 21:39:14 +00:00
compression	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
containers	test: catch regressions in the validation lines #44798 added (#47420)	2026-10-20 01:06:37 +00:00
db_scripts	fix(vector-stores): keep proxy context out of provider vector store metadata (#47021)	2026-10-17 12:51:47 -07:00
decisions	fix(decisions): bill unpriced returned TypeSafe versions at the requested model and name a missing answers field (#47508)	2026-10-20 11:46:17 -07:00
endpoints	feat(vertex-ai)!: support gemini 3.1 flash tts (#31915)	2026-10-21 04:18:42 +00:00
enterprise	feat(proxy): map baggage values to budget tags (#47358)	2026-10-20 09:09:42 +00:00
expected_fine_tuning_api	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
expected_responses_api_request	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
experimental_mcp_client	fix(mcp): upgrade to MCP SDK 2.3.0 and raise the per-event SSE size cap (#47034)	2026-10-20 16:00:00 -07:00
extraction	feat(extraction): add /v1/extraction with Cloudflare Clairic support (#47473)	2026-10-20 15:51:45 -07:00
files	test: move 81 legacy live tests in pass-through, spend, batches, audio, search, guardrails, image and ocr dirs offline (#45288)	2026-10-08 02:38:12 -07:00
fine_tuning	fix(fine_tuning): stop forwarding api_version to the OpenAI client (#44995)	2026-10-21 01:58:25 +00:00
fixtures	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
gateway	test(ci): fix six CircleCI test regressions on main (#44429)	2026-10-03 20:55:01 -07:00
google_genai	fix(langfuse_otel)!: send the completion start time (#45597)	2026-10-20 13:52:26 +00:00
harness	fix(streaming)!: send the include_usage chunk with an empty choices array (#47109)	2026-10-21 02:26:05 +00:00
images	test(images): stop writing image edit responses to disk (#47463)	2026-10-20 01:26:09 +00:00
integration_support	test(integration): wait for every worker in Scenario.model (#47277)	2026-10-18 14:49:25 -07:00
integrations	fix(proxy): attribute retry attempt spend rows to their deployment and keep them out of daily request counts (#47658)	2026-10-20 23:33:01 +00:00
interactions	fix(langfuse_otel)!: send the completion start time (#45597)	2026-10-20 13:52:26 +00:00
litellm_core_utils	fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194)	2026-10-20 21:46:45 -07:00
litellm_proxy_extras	fix(proxy-extras): accept unencoded DB passwords in the v2 migration lock and redact its errors (#46592)	2026-10-15 14:47:23 -07:00
llms	fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194)	2026-10-20 21:46:45 -07:00
models	fix(proxy): allow model instances in LiteLLM_EndUserTable validation (#41677)	2026-10-15 10:57:26 -07:00
ocr	test(rust-bridge): relocate dispatch tests before routing changes (#46926)	2026-10-16 12:29:33 -07:00
passthrough	fix(bedrock)!: stream Converse passthrough frames through post_call guardrails instead of buffering (#46307)	2026-10-17 00:53:53 -07:00
proxy	fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194)	2026-10-20 21:46:45 -07:00
rag	fix(rag)!: use team provider credentials and allow viewer and JWT team access (#45497)	2026-10-17 23:51:48 +00:00
realtime_api	fix(secret_managers)!: resolve oidc/file and oidc/env refs in admin-configured api_key per request (#47341)	2026-10-20 01:43:59 +00:00
repositories	fix(proxy): reset end-user spend in committed pages so the budget cascade survives a large LiteLLM_EndUserTable (#46502)	2026-10-15 19:47:12 -07:00
rerank_api	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
responses	fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194)	2026-10-20 21:46:45 -07:00
router_strategy	fix(router): unregister strategy selectors from global callbacks on discard (#45795)	2026-10-21 02:39:36 +00:00
router_utils	fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194)	2026-10-20 21:46:45 -07:00
rust_bridge	fix(logging)!: fire one CustomLogger failure hook per async call outside the async flag list (#47124)	2026-10-20 15:19:14 -07:00
sandbox	test: add __init__.py to every tests/unit directory phase 16 touches	2026-09-20 11:52:38 +00:00
search	fix(search): price Tavily advanced and Linkup deep searches at their own cost map entries (#47411)	2026-10-19 23:32:31 -07:00
secret_managers	fix(secret_managers)!: resolve oidc/file and oidc/env refs in admin-configured api_key per request (#47341)	2026-10-20 01:43:59 +00:00
skills	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
systemone	fix(decisions): answer 400 on a malformed provider_specific_header instead of dropping it (#46619)	2026-10-15 14:04:03 +00:00
telemetry	feat(telemetry): add AggregatingSink, fixed-bucket histograms, Report and HttpExporter (#45487)	2026-10-13 18:33:01 -07:00
test_router	fix(router): log each dropped /v1/messages attempt through its own logging copy and open the retry without its usage (#45194)	2026-10-20 21:46:45 -07:00
tracing	fix(proxy): cooldown errors carry 429, Sentry starts at boot without request bodies, tracing failures log at ERROR, exporter counters exported (#46344)	2026-10-16 00:53:52 +00:00
types	fix(streaming)!: send the include_usage chunk with an empty choices array (#47109)	2026-10-21 02:26:05 +00:00
vector_stores	fix(secret_managers)!: resolve oidc/file and oidc/env refs in admin-configured api_key per request (#47341)	2026-10-20 01:43:59 +00:00
videos	test: migrate phase 16 legacy tests to tests/unit	2026-09-20 10:59:02 +00:00
__init__.py	test(unit): add package markers to migrated unit test directories	2026-09-20 11:53:14 +00:00
AGENTS.md	docs: clarify unit test clock rule (#47604)	2026-10-20 11:33:01 -07:00
conftest.py	fix(router): unregister strategy selectors from global callbacks on discard (#45795)	2026-10-21 02:39:36 +00:00
create_mock_standard_logging_payload.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
test_a2a_registry_lookup.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_acompletion_session_reuse_e2e.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_add_deployment_no_master_key.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_aembedding_session_reuse_e2e.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_anthropic_beta_headers_filtering.py	fix(vertex_ai): forward the inline-tools-2026-09-15 beta to Vertex and Anthropic (#45297)	2026-10-08 12:27:52 -07:00
test_anthropic_skills_transformation.py	feat(anthropic): workload identity federation and pluggable identity sources (#44448)	2026-10-03 17:08:30 -07:00
test_assert_ci_coverage.py	docs(agents): keep directory rules in nested AGENTS.md and pin integration tests to CircleCI (#46796)	2026-10-16 14:57:49 -07:00
test_assert_workflow_dir_hygiene.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_audio_transcription_rust_bridge.py	refactor(python-bridge): ship a signature base and read the resolved call (#45450)	2026-10-08 17:20:29 -07:00
test_auto_update_price_and_context_window_file.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_azure_ad_token_credential_resolution.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_azure_ai_grok_4_3_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_azure_ai_grok_4_6_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_baseten_glm_5_3_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_batch_completion_models_all_responses.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_bedrock_marengo_embed_3_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_build_core_distribution.py	test: move packaging and install checks off CircleCI build_and_test (#45757)	2026-10-10 09:33:51 -07:00
test_chat_ui_responses_session.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_check_licenses.py	feat(proxy): embed enterprise LiteAdmin MCP in LiteLLM images (#44610)	2026-10-05 15:24:34 -07:00
test_check_mcp_operation_boundary.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_check_migrations_lock_timeout.py	fix(proxy-extras): bound migration lock waits with SET LOCAL lock_timeout in the migration SQL (#46329)	2026-10-13 20:51:03 -07:00
test_check_migrations_no_data_rewrites.py	fix(proxy-extras): build the SpendLogs indexes in the migration job instead of in migrations (#43948)	2026-10-01 14:12:22 -07:00
test_check_openapi_docs.py	ci: gate undocumented POST routes in the proxy OpenAPI document (#45843)	2026-10-10 21:51:00 +00:00
test_check_py310_typing_imports.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_check_test_quality.py	test(integration): hand every harness server a port from one per-worker block (#46761)	2026-10-15 16:56:40 -07:00
test_check_type_discipline.py	ci(lint): gate every rule on its merge-base count and cap Anys at a fixed total (#40193)	2026-10-08 05:39:29 +00:00
test_check_unbounded_in_lists.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
test_check_windows_wheel_install.py	test: move packaging and install checks off CircleCI build_and_test (#45757)	2026-10-10 09:33:51 -07:00
test_circleci_path_filter.py	ci(cost map): delete the model prices JSON schema file (#47079)	2026-10-21 01:46:03 +00:00
test_circleci_run_migration_tests.py	test: migrate proxy security, schema migration and MCP legacy tests (#45937)	2026-10-11 16:17:24 -07:00
test_circleci_rust_toolchain.py	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
test_claude_fable_5_config.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_claude_haiku_5_5_config.py	fix(model_prices): consolidate claude-haiku-5-5 over-100k pricing and capability flags (#45151)	2026-10-07 14:14:47 -07:00
test_claude_opus_4_6_config.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_claude_opus_4_8_config.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_claude_opus_5_config.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_claude_sonnet_5_config.py	refactor(cost-map): remove openrouter rows, part 5 of 5 (#45669)	2026-10-09 22:48:55 +00:00
test_cloudflare_workers_ai_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_completion_timeout_resolution.py	fix(router)!: bound fake-streamed calls by the request timeout, not stream_timeout (#47162)	2026-10-17 22:08:02 +00:00
test_component_entrypoint.py	feat(prometheus): cap series per metric for every labeled metric (#44420)	2026-10-06 01:28:44 +00:00
test_compression.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_conftest_isolation.py	test: isolate model cost maps in runtime registration tests (#47559)	2026-10-20 16:18:13 +00:00
test_constants.py	fix(mcp): upgrade to MCP SDK 2.3.0 and raise the per-event SSE size cap (#47034)	2026-10-20 16:00:00 -07:00
test_container_router.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_cost_calculation_log_level.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_cost_calculator.py	feat(vertex-ai)!: support gemini 3.1 flash tts (#31915)	2026-10-21 04:18:42 +00:00
test_cost_map_guard.py	ci(cost map): delete the model prices JSON schema file (#47079)	2026-10-21 01:46:03 +00:00
test_count_tokens_public_api.py	fix(responses)!: count input tokens the way inference sends the request (#47363)	2026-10-20 15:13:59 +00:00
test_dashscope_image_generation.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_daybreak_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_deepseek_model_metadata.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_default_branch.py	ci(lint): gate every rule on its merge-base count and cap Anys at a fixed total (#40193)	2026-10-08 05:39:29 +00:00
test_detect_changes.py	ci: render lint, unit and smoke checks as <tier> / <job> with one collector per tier (#45480)	2026-10-09 04:28:41 +00:00
test_docker_no_network_on_deploy.py	test: migrate local_testing SDK and provider tests out of build_and_test (#45760)	2026-10-10 23:14:25 +00:00
test_dockerfile_apk_repository.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_dockerfile_bedrock_realtime_extra.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_dockerfile_non_root.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_drop_params_env_var.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_e2e_egress_sentinel.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_eager_tiktoken_load.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_env_key_doc_gate.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_exception_exports.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_exception_header_preservation.py	fix: support OpenAI SDK 3 while retaining SDK 2 compatibility (#44927)	2026-10-09 19:45:50 -07:00
test_exception_mapping_request_attribute.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_fake_openai_endpoint.py	test: migrate local_testing SDK and provider tests out of build_and_test (#45760)	2026-10-10 23:14:25 +00:00
test_filter_out_litellm_params.py	fix(params): validate stream_chunk_size once, before any provider call (#43222)	2026-09-26 23:01:20 +00:00
test_fireworks_serverless_model_costs.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gate_slot_lock.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gemini_3_1_flash_lite_image_pricing.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gemini_4_argon_model_metadata.py	feat(gemini)!: auto-continue gemini-4-argon long decodes with continuationToken (#46240)	2026-10-15 22:54:23 +00:00
test_gemini_tts_native_audio_pricing.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_get_blog_posts.py	feat(ui): source Home What's new from day 0 support blog posts (#46260)	2026-10-13 13:11:59 -07:00
test_git_hooks.py	chore(hooks): drop Conventional Branches pre-push hook in favor of litellm_ prefix (#44951)	2026-10-20 00:35:39 +00:00
test_gpt_5_4_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gpt_5_5_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gpt_image_cost_calculator.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gpt_realtime_mode.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_groq_streaming_encoding.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_guardrail_exception_status_codes.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_integration_run.py	test(integration): isolate every multi-worker integration suite by default (#46027)	2026-10-12 03:46:06 -07:00
test_internal_context.py	fix(proxy)!: stop update_cache from resurrecting evicted auth cache entries (#46997)	2026-10-20 17:09:53 +00:00
test_lazy_imports.py	feat(sdk): build core from an independent packaging manifest (#44340)	2026-10-08 18:40:14 -07:00
test_lint_base_counts.py	revert(lint-gates): accept an empty base scan again, since zero violations is a legitimate count (#45319)	2026-10-08 08:40:08 +00:00
test_lint_workflow_diff_gates.py	fix(ci): align misc unit tests with NativeCall bridge and widened e2e diff gates (#45180)	2026-10-07 16:33:49 -07:00
test_litellm_cli.py	perf(cli): start lite without initializing the litellm SDK (#46803)	2026-10-17 04:53:32 +00:00
test_litellm_overhead.py	test(unit): wait on the work itself instead of fixed sleeps (#46261)	2026-10-13 12:41:06 -07:00
test_litellm_params_reserved_keys.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_logging.py	fix(logging): keep root logger INFO lines when json_logs is on and LITELLM_LOG is set (#47175)	2026-10-17 21:33:26 +00:00
test_lowest_latency_zero_tokens.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_main.py	fix(streaming)!: send the include_usage chunk with an empty choices array (#47109)	2026-10-21 02:26:05 +00:00
test_main_module_header.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_mistral_large_4_model_metadata.py	fix(model_prices): add Bedrock flex prices, Anthropic web search flags, Gemini shutdown dates, OpenRouter alias drift, Mistral Large 4 context (#44910)	2026-10-08 13:12:42 -07:00
test_mistral_medium_3_5_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_mistral_small_4_0_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_mistral_zai_glm_5_2_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_model_block_unblock.py	fix(proxy): return 4xx instead of 500 for missing required params, invalid pagination and unknown ids (#43787)	2026-10-02 22:48:53 -07:00
test_model_cost_aliases.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_model_param_helper.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_model_prices_and_context_window.py	fix(gemini)!: honor supports_sampling_params on the Gemini and Vertex path and flag Gemini 3.6 Flash, 3.5 Flash-Lite and later (#47645)	2026-10-20 23:51:55 +00:00
test_model_response_normalization.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_muse_spark_1_1_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_muse_spark_1_2_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_muse_spark_1_3_model_metadata.py	feat(model_prices): add meta/muse-wonder-1.0 (#46072)	2026-10-12 19:36:52 +00:00
test_mutation_report.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_nested_drop_params.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_no_top_level_test_invocations.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_non_chat_routes_open_llm_spans.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_openai_embedding_encoding_format_default.py	test: migrate local_testing SDK and provider tests out of build_and_test (#45760)	2026-10-10 23:14:25 +00:00
test_openai_record_replay_proxy.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_openai_service_tier_long_context_pricing.py	fix(cost_calculator): bill ultrafast prompts above 272k at the ultrafast long-context rates (#43764)	2026-09-30 07:32:16 -07:00
test_openapi_docs_gate.py	ci: gate undocumented POST routes in the proxy OpenAPI document (#45843)	2026-10-10 21:51:00 +00:00
test_package_layout.py	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
test_package_metadata.py	chore(deps): require anyio>=4.14.0 to rule out the lock-waiter deadlock (#47378)	2026-10-19 12:37:47 -07:00
test_pre_commit_lint.py	ci(lint): gate every rule on its merge-base count and cap Anys at a fixed total (#40193)	2026-10-08 05:39:29 +00:00
test_prisma_generate_if_needed.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_private_usage_aliases.py	feat(openai)!: honor per-deployment workload identity on non-chat routes (#39966)	2026-10-16 22:25:15 +00:00
test_process_helpers.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_project_alias_tracking.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_project_tags_pydantic.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_proxy_auth.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_pydantic_namespaces.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_rag_openai_ingestion.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_rate_limit_error_unification.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_read_rc_version.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_redact_string_in_error_paths.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_redis.py	test: move routing, caching and callback tests out of local_testing (#45761)	2026-10-10 09:33:09 -07:00
test_redis_credential_provider.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_register_model_custom_pricing.py	fix(register_model)!: keep bedrock geo deployments priced across price data reloads (#41523)	2026-10-17 19:10:04 +00:00
test_register_model_zero_cost_persistence.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_replicate_model_key_format.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_responses_api_bridge_non_stream.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_responses_id_security.py	fix(proxy): check previous_response_id ownership on /v1/responses/compact (#46408)	2026-10-14 17:57:34 +00:00
test_responses_streaming_container_ownership.py	fix(responses): bill a background response once, on the first read or poll that sees it finished (#45703)	2026-10-15 11:00:14 -07:00
test_retrieve_batch_bedrock_dispatch.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_router_block_helpers.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_router_exception_redaction.py	fix(streaming)!: map stream read timeouts to litellm.Timeout on chat, messages, and responses (#47198)	2026-10-18 13:58:34 +00:00
test_router_get_settings.py	ci(circleci): test Redis behavior against local Redis and print short tracebacks (#44062)	2026-10-01 13:00:54 -07:00
test_router_google_genai.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_model_cost_isolation.py	fix(gemini)!: honor supports_sampling_params on the Gemini and Vertex path and flag Gemini 3.6 Flash, 3.5 Flash-Lite and later (#47645)	2026-10-20 23:51:55 +00:00
test_router_order_fallback.py	fix(router): keep the prompt caching affinity pin alive as long as the prefix's cache_control ttl (#46084)	2026-10-14 21:10:09 -07:00
test_router_per_deployment_num_retries.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_redis_init.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_retry_backoff_headers.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_retry_non_retryable_errors.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_retry_policy_update.py	fix(proxy): unset DB environment variables removed from the row on every worker by row revision (#46709)	2026-10-17 03:51:05 +00:00
test_router_silent_experiment.py	test: fix stale and flaky tests across CircleCI, GHA and Buildkite (#45530)	2026-10-09 11:40:14 -07:00
test_router_streaming_fallback_metadata.py	refactor: expose public hidden_params accessors (#44668)	2026-10-07 00:01:33 -07:00
test_router_weighted_failover.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_ruff_strict_gate.py	ci(lint): gate every rule on its merge-base count and cap Anys at a fixed total (#40193)	2026-10-08 05:39:29 +00:00
test_sambanova_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_scaledown_model_prices.py	feat(scaledown): add native text provider support (#44168)	2026-10-10 14:01:17 -07:00
test_scheduler.py	fix(scheduler): remove a request's queue entry once it stops waiting (#43061)	2026-10-07 17:34:38 -07:00
test_secret_redaction.py	fix(vertex): report an unreadable credentials file as a read failure (#40173)	2026-10-15 02:03:56 -07:00
test_seed_tracing_fixtures.py	refactor(lens): connect LiteLLM to the independent Lens service (#45529)	2026-10-09 16:17:05 -07:00
test_select_ui_test_scope.py	ci: render lint, unit and smoke checks as <tier> / <job> with one collector per tier (#45480)	2026-10-09 04:28:41 +00:00
test_service_logger.py	test: move 76 live top-level tests to offline unit and integration coverage (#45352)	2026-10-08 10:33:35 -07:00
test_setup_wizard.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_shared_session_integration.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_socket_policy.py	test(unit): block external sockets at import time and add a socket policy regression test	2026-09-20 08:07:50 +00:00
test_ssl_verify_unit.py	test(unit): stop test modules from putting their own directory on sys.path (#43421)	2026-09-28 12:20:20 -07:00
test_stream_chunk_builder_annotations.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_stream_chunk_builder_citations.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_stream_chunk_builder_images.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_streaming_connection_cleanup.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_sync_together_ai_models.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_system_message_format_bug.py	fix(prompt_templates): do not mutate messages in-place in function_call_prompt (#41676)	2026-10-15 14:37:11 -07:00
test_test_quality_gate.py	ci(lint): gate every rule on its merge-base count and cap Anys at a fixed total (#40193)	2026-10-08 05:39:29 +00:00
test_thinking_enabled.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_together_ai_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_tool_loop.py	fix(responses bridge): round-trip tool_search_call and tool_search_output items between turns (#46444)	2026-10-14 21:40:14 -07:00
test_type_check_gate.py	ci(lint): gate every rule on its merge-base count and cap Anys at a fixed total (#40193)	2026-10-08 05:39:29 +00:00
test_type_discipline_gate.py	ci(lint): gate every rule on its merge-base count and cap Anys at a fixed total (#40193)	2026-10-08 05:39:29 +00:00
test_typesafe_model_metadata.py	fix(cost): price typesafe/jev-1.14.0 (#46594)	2026-10-14 20:27:35 -07:00
test_unit_shard_missing_paths.py	ci: render lint, unit and smoke checks as <tier> / <job> with one collector per tier (#45480)	2026-10-09 04:28:41 +00:00
test_unit_shard_per_test_timeout.py	ci: render lint, unit and smoke checks as <tier> / <job> with one collector per tier (#45480)	2026-10-09 04:28:41 +00:00
test_utils.py	fix(router): unregister strategy selectors from global callbacks on discard (#45795)	2026-10-21 02:39:36 +00:00
test_utils_get_model_info.py	fix(bedrock): use native structured output on Haiku 5.5 and Sonnet 5.5, and fix Fable 5 and Sonnet 4.6 schema 400s (#46870)	2026-10-16 20:57:23 -07:00
test_utils_get_optional_params.py	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
test_utils_module_docstring.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_uuid_helper.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_vcr_classification.py	test: move offline logging, secret manager and provider tests from legacy dirs into tests/unit (#45554)	2026-10-09 09:48:10 -07:00
test_vcr_conftest_common_banner.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_vcr_filters.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_vcr_leak_guard.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_vcr_redis_persister.py	test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759)	2026-10-11 07:58:53 +00:00
test_vcr_safe_body_matcher.py	fix(tests): stop VCR recording and replaying a test's own localhost upstream (#43346)	2026-09-26 15:49:39 -07:00
test_version.py	feat(sdk): build core from an independent packaging manifest (#44340)	2026-10-08 18:40:14 -07:00
test_vertex_ai_xai_grok_prompt_caching_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_video_generation.py	fix(videos)!: keep model_id in proxy video ids so per-model keys resolve on status/content (#44614)	2026-10-20 05:42:59 +00:00
test_with_dashboard_node.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_ws_vcr.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_xai_grok_4_3_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_xai_responses_auto_routing.py	fix(router)!: stop a chat-mode Mantle deployment from rewriting the shared Responses routing row (#46263)	2026-10-17 21:39:14 +00:00