narmstrong-berri a5533cbcfd feat(router): add the Rust router core and serve routing through it behind LITELLM_RUST ... litellm-router-core implements the router core in Rust: a versioned registry with Python's deployment ids, selection with native simple-shuffle, the retry, fallback and cooldown loop with Python's cache keys, and per-attempt executors with a native seam for Messages to Anthropic. The python bridge exposes it as RouterCoreHandle, whose call loop is step driven so Rust never awaits Python. RustCore drives that loop for completions, messages, embeddings and responses and serves everything else from a PythonCore built from the same config. A new router rule in the route catalog opts in with LITELLM_RUST, and any config the Rust core cannot serve gets PythonCore at construction The call loop follows Python's fallback walk (per-target depth, a level raising its own error, lookup by the current and requested group, "*" after specific chains), stamps retries the way an exhausted retry loop does, and leaves health writes to the Python attempt, which records them. RustCore builds its handle from the constructor arguments and the applied changesets and rebuilds it when either version moves. The core unit suite runs on RustCore too		2026-10-31 12:54:27 -07:00
..
azure_client_usage_test.py
ban_constant_numbers.py
ban_copy_deepcopy_kwargs.py	Fix - using managed files w/ OTEL + UI - add model group alias on UI (#13171)	2025-07-31 21:22:04 -07:00
bedrock_pricing.py	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_ruff_dead_test_code	2026-08-24 09:46:56 -07:00
callback_manager_test.py
check_data_replace_usage.py
check_e2e_no_raw_requests.py	test(mcp): replace the live Linear MCP OAuth e2e tests with integration coverage (#47154)	2026-10-17 14:29:59 -07:00
check_endpoint_coverage.py	Revert "[Feature] Add /public/supported_endpoints endpoint"	2026-02-26 17:21:43 -08:00
check_fastuuid_usage.py	code cov test script check_fastuuid_usage.py	2025-09-24 10:27:22 +09:00
check_get_model_cost_key_performance.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
check_guardrail_apply_decorator.py	content filter test fix	2026-02-12 17:54:16 -08:00
check_licenses.py	feat(proxy): embed enterprise LiteAdmin MCP in LiteLLM images (#44610)	2026-10-05 15:24:34 -07:00
check_migrations_lock_timeout.py	fix(proxy-extras): bound migration lock waits with SET LOCAL lock_timeout in the migration SQL (#46329)	2026-10-13 20:51:03 -07:00
check_migrations_no_data_rewrites.py	fix(proxy-extras): build the SpendLogs indexes in the migration job instead of in migrations (#43948)	2026-10-01 14:12:22 -07:00
check_no_none_string_error_fields.py	fix(proxy)!: stop answering with the literal string "None" as error type and param on the proxy-server, auth, spend, and key health routes (#39540)	2026-10-29 18:20:52 -07:00
check_no_publicly_known_master_key.py	fix(ui): rebuild the dashboard bundle and cover it in the example master key check (#47612)	2026-10-20 13:02:29 -07:00
check_prisma_binary_cache.py	fix(ci): bound setup steps so pytest always gets its full budget	2026-08-10 16:22:07 +00:00
check_provider_folders_documented.py	feat(harness): add pi harness for litellm.agent() (#45467)	2026-10-20 09:01:40 +00:00
check_py310_typing_imports.py	fix: keep litellm importable on Python 3.10 and guard 3.11-only typing imports in CI (#39448)	2026-09-02 18:27:19 -07:00
check_spanattributes_value_usage.py	test: drop the cwd-relative sys.path.insert calls from the test suite (#37802)	2026-08-22 09:25:58 -07:00
check_telemetry_imports.py	feat(telemetry): add litellm.telemetry records, semantic group consent and sink protocol (#45484)	2026-10-13 18:19:22 -07:00
check_unbounded_in_lists.py	ci: fail on new unbounded SQL IN lists and add a Prisma chunking helper (#42629)	2026-09-26 13:40:44 -07:00
check_unsafe_enterprise_import.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
check_workflow_job_name_collisions.py	fix(ci): keep an expression matrix directive out of the comparison	2026-09-06 02:59:16 -07:00
check_workflow_startup_safety.py	ci: render lint, unit and smoke checks as <tier> / <job> with one collector per tier (#45480)	2026-10-09 04:28:41 +00:00
code_qa_check_tests.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
enforce_llms_folder_style.py	test: drop the cwd-relative sys.path.insert calls from the test suite (#37802)	2026-08-22 09:25:58 -07:00
ensure_async_clients_test.py	refactor(mcp): drop the experimental label from the MCP server and client paths (#48513)	2026-10-27 17:47:50 +00:00
info_log_check.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
liccheck.ini	fix(security): stop trusting the compromised eMudhra root CA (#47670)	2026-10-22 02:09:52 +00:00
license_cache.json	fix(deps): update python-multipart to >=0.0.20 in CI and test configs	2026-03-03 15:10:39 -03:00
litellm_logging_code_coverage.py	docs(litellm_logging_code_coverage.py): fix check	2025-06-18 21:36:03 -07:00
log.txt
memory_test.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
prevent_key_leaks_in_exceptions.py
recursive_detector.py	refactor(router): extract PythonCore behind RouterCore and pass the router its config (#49119)	2026-10-31 12:54:23 -07:00
router_code_coverage.py	fix(gemini): add thought_signature_in_tool_call_id to keep tool call ids short for clients that cap them (#47692)	2026-10-31 03:20:42 -07:00
router_enforce_line_length.py
router_litellm_globals_check.py	feat(router): add the Rust router core and serve routing through it behind LITELLM_RUST	2026-10-31 12:54:27 -07:00
router_surface_allowlist.json	refactor(router): route the router family through RoutingContext and close the outside surface (#49118)	2026-10-30 19:18:54 -07:00
router_surface_check.py	feat(router): add the Rust router core and serve routing through it behind LITELLM_RUST	2026-10-31 12:54:27 -07:00
test_aio_http_image_conversion.py	fix img URL for tests	2025-11-22 09:41:15 -08:00
test_ban_set_verbose.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_chat_completion_imports.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_check_no_none_string_error_fields.py	fix(proxy)!: stop answering with the literal string "None" as error type and param on the proxy-server, auth, spend, and key health routes (#39540)	2026-10-29 18:20:52 -07:00
test_check_no_publicly_known_master_key.py	fix(ui): rebuild the dashboard bundle and cover it in the example master key check (#47612)	2026-10-20 13:02:29 -07:00
test_e2e_idp_stack.py	test(e2e): verify IdP readiness through real HTTP	2026-09-11 17:25:38 -07:00
test_e2e_junit_report.py	test(mcp): replace the live Linear MCP OAuth e2e tests with integration coverage (#47154)	2026-10-17 14:29:59 -07:00
test_e2e_metadata.py	ci: render lint, unit and smoke checks as <tier> / <job> with one collector per tier (#45480)	2026-10-09 04:28:41 +00:00
test_generate_provider_endpoints_support.py	feat: generate provider_endpoints_support.json from the cost map (#48619)	2026-10-27 12:06:55 -07:00
test_merge_smoke.py	ci: render lint, unit and smoke checks as <tier> / <job> with one collector per tier (#45480)	2026-10-09 04:28:41 +00:00
test_no_hardcoded_secrets.py	test: run the 30 test files stranded in the second mirror (#37595)	2026-08-20 10:59:43 -07:00
test_provider_cache.py	fix(e2e): own a shared fixture's deployment by the fixture's node, not the first test	2026-09-16 17:35:05 -07:00
test_provider_replay_harness.py	test(e2e): move the harness self-tests out of tests/e2e (#45172)	2026-10-07 22:20:02 +00:00
test_proxy_types_import.py	refactor(logging): load enterprise alerting loggers lazily so import litellm skips proxy types (#44762)	2026-10-05 22:06:53 -07:00
test_router_strategy_async.py	test: drop the cwd-relative sys.path.insert calls from the test suite (#37802)	2026-08-22 09:25:58 -07:00
test_unit_passed_gate.py	ci: render lint, unit and smoke checks as <tier> / <job> with one collector per tier (#45480)	2026-10-09 04:28:41 +00:00
test_workflow_job_name_collisions.py	fix(ci): keep an expression matrix directive out of the comparison	2026-09-06 02:59:16 -07:00
unbounded_in_baseline.txt	refactor(router): fence the router surface and document the router-core boundary (#48839)	2026-10-29 00:01:52 +00:00