RachelHuangZW bf9f59d76b fix(scheduler): remove a request's queue entry once it stops waiting (#43061) ... * fix(scheduler): remove a request's queue entry once it stops waiting Requests admitted while a healthy deployment existed never left the priority queue, and neither did requests cancelled while waiting. The stale entries blocked later requests during cooldown and, with Redis, made add_request raise a TypeError on queues read back as JSON lists Both scheduling paths now share one polling helper that removes the entry in a finally block, whether the request was admitted, timed out or cancelled Related to #43059 * test(router): allowlist _wait_for_scheduler_turn in the router coverage check The coverage script only counts direct calls in test files. The helper is exercised through prioritized acompletion and atext_completion in test_router.py, like the other allowlisted entries * fix(scheduler): admit healthy requests before reading the queue, and clean up cancelled enqueues poll() raised on an empty queue before checking for healthy deployments. With the cleanup now rewriting the queue after every admission, a concurrent write from another replica can erase a waiting request's entry, and that request then failed while a deployment was healthy. poll() now admits as soon as a deployment is healthy and only reads the queue during cooldown add_request also moved inside the try block, so a request cancelled while its queue write is in flight still has its entry removed * refactor(scheduler): move the wait loop into Scheduler.wait_for_turn The router passes a healthy-deployments callable into the scheduler, so tests inject a Scheduler directly instead of replacing the router's scheduler attribute. The cancelled-mid-enqueue test moves to test_scheduler.py with the other scheduler tests, and poll() takes the deployments as a Sequence since it only checks whether any are healthy * test(scheduler): move scheduler tests into tests/unit * fix(scheduler): finish the queue removal when cancellation is delivered again during cleanup A second cancel, or an anyio cancel scope that re-cancels on every await, interrupted remove_request mid-write and left the entry in Redis. * fix(scheduler): read queue entries back from redis as tuples * fix(scheduler): admit a request whose queue entry vanished during cooldown * fix(scheduler): re-enqueue a request whose queue entry vanished during cooldown * test(integration): cover priority scheduler queue cleanup across instances Adds tests/integration/routing/test_priority_scheduler_queue_cleanup.py: 27 cells against the real proxy (two workers, Postgres, Redis, a scripted upstream) for every prioritized surface (/v1/chat/completions, /v1/completions, /queue/chat/completions, streaming and not, OpenAI SDK sync and async, raw httpx), the non-integer priority pass-through, the in-memory queue on one proxy, two proxies sharing a Redis queue (served requests leave no entry, a dead replica's entry is skipped or expires, a waiter that times out or disconnects removes only itself), a Redis outage mid burst and a SIGKILLed worker. Each cell asserts the caller's response, the upstream's requests by marker and the Redis queue contents. On the merge base the cross-instance cells fail with the list-of-lists TypeError and the in-memory cell with 408s behind the leaked entry; on this branch every cell passes --------- Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-07 17:34:38 -07:00
..
a2a_protocol	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
anthropic_interface	fix(proxy): send a real error event when a /v1/messages stream fails (#41826)	2026-09-25 15:36:35 -07:00
batches	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
caching	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
chat_completions	refactor(rust-bridge): unify native call inputs and Messages settings (#45126)	2026-10-07 15:05:43 -07:00
completion_extras	fix(responses): keep prompt_cache_breakpoint markers in the chat to responses bridge (#44119)	2026-10-07 16:25:36 -07:00
compression	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
containers	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
decisions	refactor: expose public hidden_params accessors (#44668)	2026-10-07 00:01:33 -07:00
embeddings	refactor(rust-bridge): unify native call inputs and Messages settings (#45126)	2026-10-07 15:05:43 -07:00
endpoints	test: add __init__.py to migrated tests/unit packages	2026-09-20 11:53:49 +00:00
enterprise	fix(prometheus): add model_group label to end-to-end latency metrics (#44860)	2026-10-07 11:18:45 -07:00
expected_fine_tuning_api	test: move tests/test_litellm/llms into tests/unit/llms (#43191)	2026-09-25 12:43:23 -07:00
expected_responses_api_request	test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit (#43199)	2026-09-25 17:10:13 -07:00
experimental_mcp_client	fix(mcp): honor scoped cache freshness (#45165)	2026-10-07 17:19:24 -07:00
files	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
fixtures	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
gateway	test(ci): fix six CircleCI test regressions on main (#44429)	2026-10-03 20:55:01 -07:00
google_genai	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
harness	feat(harness): add Harness.TOOL_LOOP, a minimal in-process tool-calling loop (#44391)	2026-10-03 17:33:01 +00:00
images	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
integration_support	fix(tests): match the lowercased bind error in the owned-proxy port-race retry (#45097)	2026-10-07 10:30:28 -07:00
integrations	feat(ui): add auto-router usage and savings table (#45152)	2026-10-07 15:04:07 -07:00
interactions	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
litellm_core_utils	fix(streaming): stop re-wrapping a bridged stream's MidStreamFallbackError (#44989)	2026-10-07 16:01:03 -07:00
litellm_proxy_extras	fix(proxy-extras): log v1 migration failures at ERROR so LITELLM_LOG=ERROR shows them (#44202)	2026-10-03 22:45:16 -07:00
llms	fix(anthropic): normalize images for provider token counting (#45185)	2026-10-07 16:36:27 -07:00
messages	refactor(rust-bridge): unify native call inputs and Messages settings (#45126)	2026-10-07 15:05:43 -07:00
models	feat(anthropic): workload identity federation and pluggable identity sources (#44448)	2026-10-03 17:08:30 -07:00
ocr	refactor(rust-bridge): unify native call inputs and Messages settings (#45126)	2026-10-07 15:05:43 -07:00
passthrough	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
proxy	fix(mcp): honor scoped cache freshness (#45165)	2026-10-07 17:19:24 -07:00
rag	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
realtime_api	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
repositories	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
rerank_api	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
responses	refactor(rust-bridge): unify native call inputs and Messages settings (#45126)	2026-10-07 15:05:43 -07:00
router_strategy	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
router_utils	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
rust_bridge	refactor(rust-bridge): unify native call inputs and Messages settings (#45126)	2026-10-07 15:05:43 -07:00
sandbox	test: add __init__.py to every tests/unit directory phase 16 touches	2026-09-20 11:52:38 +00:00
secret_managers	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
skills	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_router	fix(scheduler): remove a request's queue entry once it stops waiting (#43061)	2026-10-07 17:34:38 -07:00
tracing	fix(lens): preserve numeric tags and report OTLP error codes (#45206)	2026-10-08 00:31:48 +00:00
types	fix(types): serialize deferred pydantic schema builds across threads (#45034)	2026-10-07 16:35:46 -07:00
vector_stores	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
videos	test: migrate phase 16 legacy tests to tests/unit	2026-09-20 10:59:02 +00:00
__init__.py	test(unit): add package markers to migrated unit test directories	2026-09-20 11:53:14 +00:00
AGENTS.md	test: finish the non-proxy half of tests/test_litellm (#43281)	2026-09-25 22:43:41 -07:00
conftest.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_a2a_registry_lookup.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_acompletion_session_reuse_e2e.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_add_deployment_no_master_key.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_aembedding_session_reuse_e2e.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_anthropic_beta_headers_filtering.py	fix(anthropic): forward the dangerous-tool-use beta to Azure AI Foundry (#43934)	2026-09-30 16:40:11 -07:00
test_anthropic_skills_transformation.py	feat(anthropic): workload identity federation and pluggable identity sources (#44448)	2026-10-03 17:08:30 -07:00
test_assert_ci_coverage.py	ci: run unit selections from GHA test-path and drop the CircleCI unit jobs (#44461)	2026-10-05 10:49:16 -07:00
test_assert_workflow_dir_hygiene.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_audio_transcription_rust_bridge.py	fix(ci): align misc unit tests with NativeCall bridge and widened e2e diff gates (#45180)	2026-10-07 16:33:49 -07:00
test_auto_update_price_and_context_window_file.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_azure_ad_token_credential_resolution.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_azure_ai_grok_4_3_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_azure_ai_grok_4_6_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_baseten_glm_5_3_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_batch_completion_models_all_responses.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_bedrock_marengo_embed_3_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_budget_ratchet_check.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_chat_ui_responses_session.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_check_licenses.py	feat(proxy): embed enterprise LiteAdmin MCP in LiteLLM images (#44610)	2026-10-05 15:24:34 -07:00
test_check_mcp_operation_boundary.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_check_migrations_no_data_rewrites.py	fix(proxy-extras): build the SpendLogs indexes in the migration job instead of in migrations (#43948)	2026-10-01 14:12:22 -07:00
test_check_py310_typing_imports.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_check_test_quality.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_check_type_discipline.py	chore(lint): remove the LIT002 mutable-construction rule (#43971)	2026-10-01 12:24:02 -07:00
test_circleci_path_filter.py	test(e2e): move the harness self-tests out of tests/e2e (#45172)	2026-10-07 22:20:02 +00:00
test_circleci_rust_toolchain.py	ci: cut CircleCI wall time without loosening test isolation (#43347)	2026-09-26 15:34:53 -07:00
test_claude_fable_5_config.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_claude_haiku_5_5_config.py	fix(model_prices): consolidate claude-haiku-5-5 over-100k pricing and capability flags (#45151)	2026-10-07 14:14:47 -07:00
test_claude_opus_4_6_config.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_claude_opus_4_8_config.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_claude_opus_5_config.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_claude_sonnet_5_config.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_cloudflare_workers_ai_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_completion_timeout_resolution.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_component_entrypoint.py	feat(prometheus): cap series per metric for every labeled metric (#44420)	2026-10-06 01:28:44 +00:00
test_compression.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_conftest_isolation.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_constants.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_container_router.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_cost_calculation_log_level.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_cost_calculator.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_cost_map_guard.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_count_tokens_public_api.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_dashscope_image_generation.py	refactor(types): replace Any with proven types in 137 files (#44478)	2026-10-05 11:01:45 -07:00
test_daybreak_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_deepseek_model_metadata.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_default_branch.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_detect_changes.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_dockerfile_apk_repository.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_dockerfile_bedrock_realtime_extra.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_dockerfile_non_root.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_drop_params_env_var.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_e2e_egress_sentinel.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_eager_tiktoken_load.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_env_key_doc_gate.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_exception_exports.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_exception_header_preservation.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_exception_mapping_request_attribute.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_filter_out_litellm_params.py	fix(params): validate stream_chunk_size once, before any provider call (#43222)	2026-09-26 23:01:20 +00:00
test_fireworks_serverless_model_costs.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gate_slot_lock.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gemini_3_1_flash_lite_image_pricing.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gemini_tts_native_audio_pricing.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_get_blog_posts.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_git_hooks.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gpt_5_4_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gpt_5_5_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gpt_image_cost_calculator.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_gpt_realtime_mode.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_groq_streaming_encoding.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_guardrail_exception_status_codes.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_integration_run.py	test(integration): let run.py select cells by pytest node id (#44319)	2026-10-02 21:01:57 -07:00
test_internal_context.py	fix(mcp): honor scoped cache freshness (#45165)	2026-10-07 17:19:24 -07:00
test_lazy_imports.py	feat(anthropic): workload identity federation and pluggable identity sources (#44448)	2026-10-03 17:08:30 -07:00
test_lens_dev.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_lint_workflow_diff_gates.py	fix(ci): align misc unit tests with NativeCall bridge and widened e2e diff gates (#45180)	2026-10-07 16:33:49 -07:00
test_litellm_overhead.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_litellm_params_reserved_keys.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_logging.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_lowest_latency_zero_tokens.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_main.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_main_module_header.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_mistral_large_4_model_metadata.py	feat(mistral): add Mistral Large 4 (Le Chonk) support (#44870)	2026-10-07 00:35:19 +00:00
test_mistral_medium_3_5_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_mistral_small_4_0_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_mistral_zai_glm_5_2_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_model_block_unblock.py	fix(proxy): return 4xx instead of 500 for missing required params, invalid pagination and unknown ids (#43787)	2026-10-02 22:48:53 -07:00
test_model_cost_aliases.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_model_param_helper.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_model_prices_schema.py	fix(model_prices): gemini deep research input limits, vertex flash retirement dates, azure data zone gpt-6.1-sol pricing (#44633)	2026-10-06 07:40:25 -07:00
test_model_response_normalization.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_muse_spark_1_1_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_muse_spark_1_2_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_muse_spark_1_3_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_mutation_report.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_nested_drop_params.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_no_top_level_test_invocations.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_non_chat_routes_open_llm_spans.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_openai_embedding_encoding_format_default.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_openai_record_replay_proxy.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_openai_service_tier_long_context_pricing.py	fix(cost_calculator): bill ultrafast prompts above 272k at the ultrafast long-context rates (#43764)	2026-09-30 07:32:16 -07:00
test_openrouter_gpt_image_model_metadata.py	fix(model_prices): registry audit 2026-10-03, add cohere embed v5, grok-imagine-video-1.5-lite and openrouter gpt-image rows (#44376)	2026-10-03 12:53:07 -07:00
test_package_layout.py	test(unit): make every tests/unit directory a package so pytest collection is unique	2026-09-20 11:50:59 +00:00
test_pre_commit_lint.py	ci: cut CircleCI wall time without loosening test isolation (#43347)	2026-09-26 15:34:53 -07:00
test_prisma_generate_if_needed.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_private_usage_aliases.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_process_helpers.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_project_alias_tracking.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_project_tags_pydantic.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_proxy_auth.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_pydantic_namespaces.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_rag_openai_ingestion.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_rate_limit_error_unification.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_read_rc_version.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_redact_string_in_error_paths.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_redis.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_redis_credential_provider.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_register_model_custom_pricing.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_register_model_zero_cost_persistence.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_replicate_model_key_format.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_responses_api_bridge_non_stream.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_responses_id_security.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_responses_streaming_container_ownership.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_retrieve_batch_bedrock_dispatch.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_router_block_helpers.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_router_exception_redaction.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_get_settings.py	ci(circleci): test Redis behavior against local Redis and print short tracebacks (#44062)	2026-10-01 13:00:54 -07:00
test_router_google_genai.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_model_cost_isolation.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_router_order_fallback.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_router_per_deployment_num_retries.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_redis_init.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_retry_backoff_headers.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_retry_non_retryable_errors.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_router_retry_policy_update.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_router_silent_experiment.py	fix(router): keep silent_model out of embedding provider requests (#44064)	2026-10-01 13:06:29 -07:00
test_router_streaming_fallback_metadata.py	refactor: expose public hidden_params accessors (#44668)	2026-10-07 00:01:33 -07:00
test_router_weighted_failover.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_ruff_strict_gate.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_sambanova_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_scheduler.py	fix(scheduler): remove a request's queue entry once it stops waiting (#43061)	2026-10-07 17:34:38 -07:00
test_secret_redaction.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_seed_tracing_fixtures.py	fix(tracing): preserve optional provider evidence in fixture replay (#44930)	2026-10-06 14:00:40 -07:00
test_select_ui_test_scope.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_service_logger.py	fix(otel): name postgres service spans by operation and table (#44240)	2026-10-03 09:20:28 -07:00
test_setup_wizard.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_shared_session_integration.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_socket_policy.py	test(unit): block external sockets at import time and add a socket policy regression test	2026-09-20 08:07:50 +00:00
test_ssl_verify_unit.py	test(unit): stop test modules from putting their own directory on sys.path (#43421)	2026-09-28 12:20:20 -07:00
test_stream_chunk_builder_annotations.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_stream_chunk_builder_citations.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_stream_chunk_builder_images.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_streaming_connection_cleanup.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_sync_together_ai_models.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_system_message_format_bug.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_test_quality_gate.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_thinking_enabled.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_together_ai_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_tool_loop.py	feat(sdk): add run_tool_loop and arun_tool_loop helpers (#44381)	2026-10-03 20:10:30 -07:00
test_type_check_gate.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_type_discipline_gate.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_typesafe_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_unit_shard_missing_paths.py	ci: run unit selections from GHA test-path and drop the CircleCI unit jobs (#44461)	2026-10-05 10:49:16 -07:00
test_unit_shard_per_test_timeout.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_utils.py	fix(model_prices): consolidate claude-haiku-5-5 over-100k pricing and capability flags (#45151)	2026-10-07 14:14:47 -07:00
test_utils_get_model_info.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_utils_get_optional_params.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_utils_module_docstring.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_uuid_helper.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_vcr_classification.py	test: move the unit half of 126 mixed legacy files into tests/unit (#45090)	2026-10-07 14:07:43 -07:00
test_vcr_conftest_common_banner.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_vcr_filters.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_vcr_leak_guard.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_vcr_redis_persister.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_vcr_safe_body_matcher.py	fix(tests): stop VCR recording and replaying a test's own localhost upstream (#43346)	2026-09-26 15:49:39 -07:00
test_vertex_ai_xai_grok_prompt_caching_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_video_generation.py	refactor(llms): expose public names for private provider helpers (#45037)	2026-10-07 08:49:25 -07:00
test_with_dashboard_node.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_ws_vcr.py	test: move whole-unit legacy test files into tests/unit and delete dead skips (#44807)	2026-10-07 05:02:28 +00:00
test_xai_grok_4_3_model_metadata.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00
test_xai_responses_auto_routing.py	test: move tests/test_litellm root and small trees into tests/unit (#43186)	2026-09-25 11:30:43 -07:00