Kazuki Hashimoto c8ed5ccca8 fix(router): unregister strategy selectors from global callbacks on discard (#45795) ... * fix(router): unregister strategy selectors from global callbacks on discard Router.discard only removed its own bound methods from litellm's callback lists, so the strategy selectors it registered (least-busy, usage-based, latency-based, cost-based and routing group selectors) stayed behind and kept receiving events after the router was gone. Reuse the identity based unregister that update_settings already uses so a discarded router takes only its own selectors with it * fix(router): purge discarded selectors from every event callback list function_setup copies litellm.callbacks into the success and failure lists on every request, so a router that served traffic still leaked its selectors there after discard. Route the cleanup through remove_callback_from_all_lists, which now also covers input_callback, and fold the selector gathering into discard so the router coverage check sees no untested helper * fix(router): keep live routers, in-flight hooks and user_config limits intact on discard discard() now rebuilds every global callback list without the router's selectors, optional pre-call checks and own usage callbacks instead of removing them in place, so a callback loop already running never skips a hook. It then re-registers what the remaining live routers need, so a same-strategy survivor keeps its deduped handler. The proxy's per-request user_config router is discarded only after its call returns. * fix(router): bind user_config handlers to the request and tighten discard When a user_config request carries a logging object, its router is discarded before the request runs and its handlers ride on that logging object, so v1 rpm and v2 tpm limits count every request and concurrent requests count once. Without one, the router is discarded after the request as before. The router's pre-call loops also read the request-scoped handlers. discard() now refills only the handler keys it vacated, guards the callback lists and the live-router set with a lock, covers routers built without a model_list, and drops its Slack alerting, adaptive router hook and budget limiter sync task * fix(proxy): reuse one user_config router per config and bind its handlers to each request Every user_config request now goes through a cached router built once per config. Its strategy handlers leave the global callback lists and are bound to the request's logging object instead, so limits count each request once and nothing is left behind after the request. * fix(router): keep the proxy budget limiter on user_config requests A user_config router now swaps in only its strategy selectors, so the proxy's RouterBudgetLimiting stays on the request and keeps counting its spend. Usage logged after a strategy is retired, such as a request still in flight when its user_config router is evicted, now schedules one more push to Redis. * fix(proxy): init the retire fields on the key model budget limiter The key model budget limiter builds its own state instead of calling the base init, so with the proxy's Redis attached every spend increment raised on the missing retire flag and the key's model budget never counted spend. * fix(router): bind the deployment callbacks to user_config requests A cached user_config router serves requests through each request's logging object but bound only its selectors and policies there, so a failing deployment was never cooled down and its usage counters missed requests. * fix(router): retry an evicted router's budget writes and keep the adaptive header on user_config requests A retired budget limiter now keeps retrying its queued Redis increments every sync interval until Redis accepts them, instead of giving up after one failed write. The x-litellm-adaptive-router-model header now comes from one stateless hook in litellm.callbacks that holds no router, so user_config adaptive routers, whose per-router hooks are request-scoped, still answer with the header. * fix(router): lock request callback setup against router cleanup and drain in-flight budget writes on retire function_setup now edits the global callback lists under the same lock that router cleanup uses, so a router dropping its callbacks on another thread can no longer shift the indexes function_setup pops or put a dropped handler back. A budget limiter retired while a Redis write is still in flight now keeps retrying that batch if the write fails, instead of leaving the spend queued with no task left to send it. * fix(utils): set up loggers after releasing the callback lists lock function_setup held the callback lists lock while set_callbacks ran its one-time logger setup, which can block on a Slack package install, so other threads and Router.discard waited on it. The lock now covers only the list reads and writes. * test(router): annotate the retire test's locals as Final * fix(logging): skip replaced global callbacks on the input path too replace_global_callback already kept a same-key global logger out of success and failure dispatch. pre_call and post_call still sent it the input events, so a logger with an input hook could count a request start it never saw finish. Both now share one filter with the success path * test(logging): type the input-path regression test --------- Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>		2026-10-21 02:39:36 +00:00
..
_experimental	fix(mcp): list per-user auth MCP tools without a shared token (#47677)	2026-10-20 16:53:35 -07:00
a2a	test(proxy): move utils, agent_endpoints and endpoint tests into tests/unit/proxy (#44006)	2026-10-01 11:06:42 -07:00
agent_endpoints	feat(proxy)!: personal keys inherit MCP server, MCP tool and agent access from the owner's teams (#46293)	2026-10-19 16:01:40 -07:00
analytics_endpoints	fix(proxy): scope /global/activity/cache_hits analytics to the caller's own and permitted-team logs (#46210)	2026-10-14 10:01:21 +02:00
anthropic_endpoints	fix(proxy)!: answer 400 for malformed tools on count_tokens instead of crashing (#46583)	2026-10-16 14:57:53 -07:00
auth	feat(nvidia_riva)!: add riva_offline mode for offline-only ASR models (#41021)	2026-10-20 23:03:56 +00:00
batches_endpoints	fix(router)!: only prefixed caller tags route once tag_routing_prefix is set (#47428)	2026-10-20 00:12:28 -07:00
client	feat(cli): keep the claude.ai login with lite claude --subscription and save pkce in config (#47385)	2026-10-19 15:33:29 -07:00
common_utils	fix(responses): send the billed background response cost to the creating key's and team's loggers (#47506)	2026-10-20 23:22:21 +00:00
config_resolvers	test(proxy): move utils, agent_endpoints and endpoint tests into tests/unit/proxy (#44006)	2026-10-01 11:06:42 -07:00
container_endpoints	test(proxy): move utils, agent_endpoints and endpoint tests into tests/unit/proxy (#44006)	2026-10-01 11:06:42 -07:00
credential_endpoints	feat(github_copilot): support a GHE.com host on per-user Copilot credentials (#47610)	2026-10-20 14:16:35 -07:00
db	fix(proxy): show the newest health check per model group on the model hub (#47552)	2026-10-20 16:42:53 -07:00
decisions_endpoints	feat(extraction): add /v1/extraction with Cloudflare Clairic support (#47473)	2026-10-20 15:51:45 -07:00
discovery_endpoints	feat(helm): support a separate hostname per component in the componentized deploy (#46360)	2026-10-14 14:56:36 -07:00
enterprise_billing	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
example_config_yaml	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
experimental	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
fine_tuning_endpoints	fix(managed_files): send provider file ids when creating a fine-tuning job from managed files (#46552)	2026-10-19 14:40:15 -07:00
google_endpoints	feat(count_tokens)!: configurable token_count_framing and token_count_model, count source in the response (#46777)	2026-10-17 17:11:27 -07:00
guardrails	fix(streaming)!: send the include_usage chunk with an empty choices array (#47109)	2026-10-21 02:26:05 +00:00
health_endpoints	feat(extraction): add /v1/extraction with Cloudflare Clairic support (#47473)	2026-10-20 15:51:45 -07:00
hooks	fix(scim)!: delete a group through the team delete's bulk path instead of one member at a time (#47544)	2026-10-21 00:59:23 +00:00
image_endpoints	test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)	2026-10-11 00:17:21 -07:00
lens	refactor(lens): connect LiteLLM to the independent Lens service (#45529)	2026-10-09 16:17:05 -07:00
list_api	test(proxy): move utils, agent_endpoints and endpoint tests into tests/unit/proxy (#44006)	2026-10-01 11:06:42 -07:00
logging_endpoints	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
management	fix(ui): take the dashboard's user role and identity from the server (#47025)	2026-10-17 14:39:33 -07:00
management_endpoints	fix(scim)!: delete a group through the team delete's bulk path instead of one member at a time (#47544)	2026-10-21 00:59:23 +00:00
management_helpers	fix(scim)!: delete a group through the team delete's bulk path instead of one member at a time (#47544)	2026-10-21 00:59:23 +00:00
memory	test(proxy): move utils, agent_endpoints and endpoint tests into tests/unit/proxy (#44006)	2026-10-01 11:06:42 -07:00
middleware	fix(proxy): decode zstd and gzip request bodies before auth reads them (#47418)	2026-10-20 05:11:30 +00:00
ocr_endpoints	fix(proxy)!: return provider-matching 4xx for the LIT-8062 status code follow-ups (#45537)	2026-10-13 11:42:39 -07:00
openai_files_endpoint	fix(proxy)!: let proxy admin keys read raw cloud storage file ids on GET /files/{id}/content (#40621)	2026-10-20 10:58:42 +00:00
pass_through_endpoints	fix(streaming)!: send the include_usage chunk with an empty choices array (#47109)	2026-10-21 02:26:05 +00:00
policy_engine	fix(guardrails)!: preserve Bedrock Converse redactions and honor tool-only scans (#45874)	2026-10-17 20:38:14 -07:00
prompts	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
proxy_server	fix(streaming)!: send the include_usage chunk with an empty choices array (#47109)	2026-10-21 02:26:05 +00:00
public_endpoints	feat(model hub): show admin-defined custom tags and metadata from model_info (#46064)	2026-10-20 17:45:06 -07:00
rag_endpoints	fix(rag)!: use team provider credentials and allow viewer and JWT team access (#45497)	2026-10-17 23:51:48 +00:00
realtime_endpoints	test(proxy): move utils, agent_endpoints and endpoint tests into tests/unit/proxy (#44006)	2026-10-01 11:06:42 -07:00
rerank_endpoints	test(proxy): move utils, agent_endpoints and endpoint tests into tests/unit/proxy (#44006)	2026-10-01 11:06:42 -07:00
response_api_endpoints	fix(responses): send the billed background response cost to the creating key's and team's loggers (#47506)	2026-10-20 23:22:21 +00:00
response_polling	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
roi_calculator	fix: cap cold MCP schema workers at usable CPUs and deflake wall-clock unit tests (#45791)	2026-10-15 00:47:59 -07:00
search_endpoints	feat(auth): deny search tools by default when search_tool_deny_by_default is set (#44490)	2026-10-06 12:50:26 -07:00
shutdown	test(proxy): move utils, agent_endpoints and endpoint tests into tests/unit/proxy (#44006)	2026-10-01 11:06:42 -07:00
spend_tracking	fix(proxy): attribute retry attempt spend rows to their deployment and keep them out of daily request counts (#47658)	2026-10-20 23:33:01 +00:00
telemetry	feat(telemetry): add the Admin UI telemetry settings page and gated page navigation events (#45494)	2026-10-13 20:12:11 -07:00
test_configs	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
types_utils	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
ui_crud_endpoints	fix(proxy): count the whole minor line in the upgrade notice for patch releases (#46942)	2026-10-17 15:49:57 -07:00
utils	fix(proxy): requeue spend logs when a Postgres restart tears down the prisma engine mid-write (#47571)	2026-10-20 09:08:18 -07:00
vector_store_endpoints	feat(vertex_ai): let operators drop chosen anthropic-beta values on the Vertex AI pass-through routes (#47185)	2026-10-18 12:51:27 +00:00
vector_store_files_endpoints	fix(vector_stores): return managed file ids from vector store file list (#43800)	2026-10-02 21:28:50 -07:00
video_endpoints	fix(videos)!: keep model_id in proxy video ids so per-model keys resolve on status/content (#44614)	2026-10-20 05:42:59 +00:00
__init__.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
conftest.py	perf(ci): isolate and shard integration suites (#44146)	2026-10-10 11:15:19 -07:00
test__lazy_features.py	feat(mcp): accept an ID-JAG as an RFC 7523 jwt-bearer grant on the gateway token endpoint (#46748)	2026-10-16 12:16:55 -07:00
test__types.py	fix(mcp): scope gateway OAuth consent to x-mcp-servers and add explicit scope setting (#44957)	2026-10-15 15:58:34 -07:00
test_admin_mcp.py	feat(proxy): embed enterprise LiteAdmin MCP in LiteLLM images (#44610)	2026-10-05 15:24:34 -07:00
test_aiohttp_cleanup_closed.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_aiohttp_session_recovery.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_api_key_masking_in_errors.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_aproxy_startup.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_audio_speech_prometheus_hooks.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_batch_expiry.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_batch_metadata_none_fix.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_batch_retrieve_bedrock.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_batch_x_litellm_model_encoding.py	fix(rag)!: use team provider credentials and allow viewer and JWT team access (#45497)	2026-10-17 23:51:48 +00:00
test_blocked_response_usage.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_body_snapshot_callback_params.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_budget_reservation.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_bug_report_config.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_caching_routes.py	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
test_chat_completion_metadata.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_claude_code_marketplace.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_collector.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_common_request_processing.py	fix(streaming)!: send the include_usage chunk with an empty choices array (#47109)	2026-10-21 02:26:05 +00:00
test_component_allowlists.py	fix(backend): retain Prometheus metrics during startup (#47129)	2026-10-17 17:10:42 +00:00
test_conftest.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_cors_config.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_credential_slot_registry.py	feat(microsoft_365_copilot): add Microsoft 365 Copilot chat provider with OAuth token exchange (#45158)	2026-10-09 15:19:07 -07:00
test_custom_callback_input.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_custom_logger_s3_gcs.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_custom_proxy.py	test(ci): fix six CircleCI test regressions on main (#44429)	2026-10-03 20:55:01 -07:00
test_custom_tokenizer_bug.py	fix(count_tokens)!: answer 400 for Vertex partner models without a count API and OpenAI-shaped provider errors on /v1/responses/input_tokens (#47163)	2026-10-17 21:15:38 +00:00
test_db_schema_changes.py	perf(ci): isolate and shard integration suites (#44146)	2026-10-10 11:15:19 -07:00
test_deprecated_key_grace_period.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_dynamic_mcp_route.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_empty_model_list.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_enforce_user_param.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_fallback_management_endpoints.py	fix(proxy): refuse /fallback writes to a fallbacks list set in config.yaml (#45860)	2026-10-12 15:01:45 -07:00
test_fastapi_offline_routes.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_filter_models_by_team_access_group.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_get_favicon.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_get_image.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_health_check_functions.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_health_check_max_tokens.py	fix(router)!: stop a chat-mode Mantle deployment from rewriting the shared Responses routing row (#46263)	2026-10-17 21:39:14 +00:00
test_init_litellm_callbacks.py	fix(proxy): build configured logging callbacks at boot so a broken callback fails startup instead of the first request (#46378)	2026-10-14 16:51:55 +00:00
test_langfuse_passthrough_security.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_lazy_openapi_snapshot.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_litellm_pre_call_utils.py	fix(streaming)!: send the include_usage chunk with an empty choices array (#47109)	2026-10-21 02:26:05 +00:00
test_max_budget_env_var.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_mcp_asgi_response.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_model_based_routing_files_batches.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_model_deprecations_endpoint.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_model_dump_with_preserved_fields.py	fix(proxy): keep provider refusal, logprobs and system_fingerprint in chat completions (#44788)	2026-10-13 13:17:40 -07:00
test_model_id_header_propagation.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_model_info_default_limits.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_model_level_guardrails.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_model_list_aliases.py	fix(proxy): resolve model aliases to their target deployment for listing metadata (#41041)	2026-10-15 00:38:50 -07:00
test_model_list_callback_filter.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_model_list_discoverable.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_model_list_healthy_only.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_modify_response_streaming_passthrough.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_moyai_endpoints.py	test: fix flaky team delete, refusal sink, loop-blocking, Moyai tamper and model-cost leak tests (#47135)	2026-10-20 18:01:36 +00:00
test_native_compaction.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_openai_ws_passthrough_routes.py	fix(proxy): use OpenAI workload identity federation tokens on /openai_passthrough (#44140)	2026-10-03 04:07:09 +00:00
test_openapi_schema_validation.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_plugin_routes.py	chore(typing): clear 670 basedpyright Any errors by validating provider payloads at the boundary (#45388)	2026-10-13 15:35:23 -07:00
test_pointfive_dashboard_config.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_pointfive_ui_callback.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_pricing_field_strip.py	fix(proxy): strip caller base_model from spend pricing and reject lone surrogates in multipart metadata (#47639)	2026-10-20 21:14:18 +00:00
test_prisma_client_backoff_retry.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_prisma_engine_watchdog.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_prisma_migration.py	fix(proxy): always exit when database setup fails at boot (#44141)	2026-10-01 21:51:06 -07:00
test_prometheus_cleanup.py	feat(prometheus): cap series per metric for every labeled metric (#44420)	2026-10-06 01:28:44 +00:00
test_prometheus_metrics_server.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_prompt_test_endpoint.py	refactor: expose core private helpers under public names (#44871)	2026-10-07 00:05:27 +00:00
test_provider_url_destination_guard.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_proxy_cli.py	test(e2e): event_loop_stalls perf case fails on a gateway event-loop hold over 100 ms that is not on its allowlist (#46974)	2026-10-17 06:55:53 +00:00
test_proxy_config_unit_test.py	feat(mcp): add mcp_disabled_capabilities to stop advertising prompts and resources (#46563)	2026-10-15 15:15:40 -07:00
test_proxy_custom_auth.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_proxy_logging_hook_detection.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_proxy_reject_logging.py	fix(logging)!: fire one CustomLogger failure hook per async call outside the async flag list (#47124)	2026-10-20 15:19:14 -07:00
test_proxy_server.py	fix(router)!: count native Responses WebSocket turns toward deployment limits and budgets (#45727)	2026-10-19 15:35:20 +00:00
test_proxy_server_custom_logger.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
test_proxy_server_endpoints_and_startup.py	fix(proxy)!: stop update_cache from resurrecting evicted auth cache entries (#46997)	2026-10-20 17:09:53 +00:00
test_proxy_server_exception_mapping.py	test: migrate legacy unit dirs and unrun folders into tests/unit, tests/integration and tests/e2e (#45940)	2026-10-11 06:24:57 -07:00
test_proxy_setting_guardrails.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_proxy_token_counter.py	test: fix flaky team delete, refusal sink, loop-blocking, Moyai tamper and model-cost leak tests (#47135)	2026-10-20 18:01:36 +00:00
test_proxy_types.py	fix(mcp): scope gateway OAuth consent to x-mcp-servers and add explicit scope setting (#44957)	2026-10-15 15:58:34 -07:00
test_proxy_utils.py	feat(model hub): show admin-defined custom tags and metadata from model_info (#46064)	2026-10-20 17:45:06 -07:00
test_proxy_utils_model_creation_and_error_logging.py	fix(proxy): price earlier timed-out retry attempts at their own deployment's model rate (#47648)	2026-10-20 22:26:09 +00:00
test_pyroscope.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_read_model_list.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_redis_auth_cache_flag.py	fix(sso): share SAML sign-in state over Redis without enable_redis_auth_cache (#46807)	2026-10-16 02:01:04 +00:00
test_reducto_ocr_route.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_response_model_sanitization.py	fix(proxy): report requested model in streamed Responses response.model (#46662)	2026-10-17 19:52:10 +00:00
test_response_polling_pre_call_checks.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_route_a2a_models.py	feat(agents): support Databricks Agent Platform agents in the agent gateway (#45681)	2026-10-15 12:42:06 -07:00
test_route_llm_request.py	fix(router): unregister strategy selectors from global callbacks on discard (#45795)	2026-10-21 02:39:36 +00:00
test_route_priority.py	fix(proxy): let configured pass-through endpoints outrank built-in provider prefix routes (#44133)	2026-10-10 12:26:17 -07:00
test_sensitive_route_auth.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_server_root_path.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_shared_health_check.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_spend_log_cleanup.py	fix(proxy): size pass rebuilds reset row statistics with ANALYZE and keeps its reclaimable count (#47501)	2026-10-20 12:24:19 -07:00
test_swagger_chat_completions.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_team_member_update.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_team_org_move.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
test_tools_allowlist_enforcement.py	fix(proxy)!: answer 400 for malformed tools on count_tokens instead of crashing (#46583)	2026-10-16 14:57:53 -07:00
test_tracing_endpoints.py	refactor(lens): connect LiteLLM to the independent Lens service (#45529)	2026-10-09 16:17:05 -07:00
test_ui_path_detection.py	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00
test_unit_test_proxy_hooks.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_update_llm_router_resilience.py	fix(security): remove the publicly known master key from the repo (#44718)	2026-10-06 10:55:24 -07:00
test_update_spend.py	fix(proxy): strip caller base_model from spend pricing and reject lone surrogates in multipart metadata (#47639)	2026-10-20 21:14:18 +00:00
test_zero_cost_model_budget_bypass.py	refactor(proxy): expose public names for private proxy helpers (#45170)	2026-10-07 18:59:27 -07:00
test_zerobus_dashboard_config.py	test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy (#44015)	2026-10-01 18:23:31 +00:00
vertex_key.json	ci: move tests/proxy_unit_tests to tests/unit/proxy and run the proxy-db shards from litellm-tests (#42903)	2026-09-24 22:59:11 +00:00