tin-berri 32deaff015 feat(spend): rebuild the auto-router benchmarks backend as a per-session rollup (#35910) ... Folds every successful auto-routed request into LiteLLM_AutoRouterSession with one conditional upsert at spend-write time, classifying each turn (same model, first visit, return to tier, out of order) against the row's own columns so nothing is read before the write. The upsert's placeholders and argument tuple both derive from the transaction dataclass's own field order, so the SQL and the call site cannot drift apart. GET /auto_router/benchmarks aggregates the rollup, grouped by the full (router, type) identity, and never scans LiteLLM_SpendLogs. A turn's cache interaction is derived once from its usage record (savings.py owns the extraction; compute_savings_spend derives cache reads from usage_object itself), hits are counted order-independently so the overall hit rate matches its covered denominator, caller-chosen session ids are bounded before entering the primary key, and a poisoned statement drops only its own session's remaining turns. Return misses inside the recorded TTL are named for what the telemetry shows (within_ttl) rather than a presumed cause, since a provider can evict early. Savings ride each router's derived baseline by default, so the response carries no deployment-wide baseline label. Rollup retention has its own maximum_autorouter_session_retention_period setting, pattern-identical to the spend-logs knob and running in the same cleanup job on its own cutoff. Every drain trigger sizes the queues through one owner and the enqueue honors disable_spend_logs beside the tool-usage queue it mirrors.		2026-08-05 20:06:32 +00:00
..
_experimental/mcp_server	perf: build log messages lazily so filtered-out log records cost nothing (#35703)	2026-08-04 04:34:52 +00:00
a2a	fix(a2a): reject malformed protocolVersion suffixes while keeping semver prereleases	2026-07-21 13:24:58 -07:00
agent_endpoints	fix(proxy): give proxy_admin_viewer read parity with proxy_admin (#35851)	2026-08-05 18:33:55 +00:00
analytics_endpoints	feat(ui): split failed requests into their own series on the cache dashboard (#34862)	2026-07-29 09:48:17 -07:00
anthropic_endpoints	fix(claude-code): create-only skill registration with a PUT update route (LIT-4110) (#31752)	2026-08-05 01:44:56 +00:00
auth	fix(auth): return 403 from the OAuth2 enterprise gate (#35838)	2026-08-05 12:53:56 -07:00
batches_endpoints	fix(proxy): resolve named credentials on provider-only batch and files calls	2026-07-28 18:57:15 -07:00
client	feat(cli): read base_url from persistent config file (#35015)	2026-07-29 18:25:05 -07:00
common_utils	Merge pull request #35748 from BerriAI/litellm_budget_reset_uow	2026-08-04 18:06:06 -07:00
config_resolvers	feat(proxy): add SAML 2.0 SSO for the admin UI (#31429)	2026-07-24 12:51:28 -07:00
db	feat(spend): rebuild the auto-router benchmarks backend as a per-session rollup (#35910)	2026-08-05 20:06:32 +00:00
discovery_endpoints	chore: litellm oss staging160626 (#30527)	2026-06-16 18:23:13 -07:00
enterprise_billing	feat(proxy): push-based OTLP billable-request metering for enterprise deployments (#31592)	2026-07-15 12:12:52 -07:00
experimental/mcp_server
google_endpoints	chore: litellm oss staging160626 (#30527)	2026-06-16 18:23:13 -07:00
guardrails	Merge pull request #35926 from BerriAI/litellm_remove_types_ruff_exclusion	2026-08-05 12:35:02 -07:00
health_endpoints	fix(proxy): authorize /health/test_connection against loaded deployment's team_id (VERIA-441) (#31767)	2026-07-01 17:05:49 -07:00
hooks	Merge pull request #35422 from BerriAI/litellm_fix_tpm_only_dynamic_rate_limit	2026-08-01 13:02:11 -07:00
image_endpoints	fix(proxy): extend response headers hook to streaming, TTS, image gen, and pass-through (#24232)	2026-06-09 22:10:23 +02:00
logging_endpoints	feat(proxy): add POST /v1/callbacks/logs to replay logging payloads through callbacks (#31134)	2026-06-24 15:25:10 -07:00
management_endpoints	feat(spend): rebuild the auto-router benchmarks backend as a per-session rollup (#35910)	2026-08-05 20:06:32 +00:00
management_helpers	feat(team): custom metadata validation hook for team create and update (#33353)	2026-08-03 18:37:45 -07:00
memory	fix(proxy): give proxy_admin_viewer read parity with proxy_admin (#35851)	2026-08-05 18:33:55 +00:00
middleware	feat(sgr): make the gateway middleware the source of truth for successful requests (#35717)	2026-08-05 12:40:47 -07:00
openai_files_endpoint	fix(proxy): honor key-level model allowlist in provider-only credential resolution	2026-07-28 21:11:50 -07:00
pass_through_endpoints	fix(proxy): resolve pass-through credentials live from router deployments	2026-08-04 23:01:37 -07:00
policy_engine	fix(policy_engine): warn that the config-defined policy reactivates when all DB versions are deleted	2026-07-30 19:48:35 -07:00
prompts	fix(proxy): give proxy_admin_viewer read parity with proxy_admin (#35851)	2026-08-05 18:33:55 +00:00
proxy_server	feat(sgr): make the gateway middleware the source of truth for successful requests (#35717)	2026-08-05 12:40:47 -07:00
public_endpoints	fix(agents): allow optional securityScheme fields so /public/agent_hub does not 500 (#33897)	2026-07-20 18:13:09 -07:00
rag_endpoints	fix(rag): track LLM completion usage and spend for /v1/rag/query (#32438)	2026-07-17 17:45:27 +00:00
realtime_endpoints	chore: litellm oss 170626 (#30637)	2026-06-17 21:11:12 -07:00
response_api_endpoints	fix(proxy): enforce per-model budgets against resolved cursor model variants	2026-08-04 14:36:04 -07:00
shutdown	feat(proxy): native /health/drain preStop hook for graceful shutdown (#29439)	2026-06-02 16:30:44 -07:00
spend_tracking	feat(spend): rebuild the auto-router benchmarks backend as a per-session rollup (#35910)	2026-08-05 20:06:32 +00:00
test_configs
types_utils	fix(proxy): resolve router_settings.plugins dotted paths and load plugins from installed packages (#33644)	2026-07-17 11:23:18 -07:00
ui_crud_endpoints	feat(ui): add admin-configurable user banner (#35729)	2026-08-04 09:24:29 -07:00
utils	fix(spend): bound each spend-log write statement by payload bytes (#34956)	2026-08-01 13:53:36 -07:00
vector_store_endpoints	test(vector_store): update credential resolution assertion for team_id kwarg	2026-07-18 18:41:12 +00:00
video_endpoints	test(videos): add 1:1 test file scaffold for videos component paths (#30631)	2026-06-29 09:12:51 +05:30
__init__.py
conftest.py	fix(proxy): avoid DB outage during planned RDS IAM rotation (#34749)	2026-07-28 13:27:50 -07:00
test_aiohttp_cleanup_closed.py
test_aiohttp_session_recovery.py
test_api_key_masking_in_errors.py
test_audio_speech_prometheus_hooks.py	fix(proxy): extend response headers hook to streaming, TTS, image gen, and pass-through (#24232)	2026-06-09 22:10:23 +02:00
test_batch_expiry.py	fix(proxy): strip LiteLLM policy tracking from OpenAI batch metadata (#28425)	2026-05-26 11:35:42 -07:00
test_batch_metadata_none_fix.py
test_batch_retrieve_bedrock.py
test_batch_x_litellm_model_encoding.py	test(batches): move orphan tests into tests/test_litellm for CI coverage (#30510)	2026-06-16 10:20:59 -07:00
test_blocked_response_usage.py	feat: litellm oss staging (#31935)	2026-07-03 09:27:31 +05:30
test_budget_reservation.py	revert(proxy)!: stop enforcing user budget on team keys (#35271)	2026-07-30 20:19:49 +00:00
test_caching_routes.py	Litellm oss staging 040626 (#29671)	2026-06-04 11:07:20 -07:00
test_chat_completion_metadata.py
test_common_request_processing.py	fix(router): eagerly fetch Vertex AI deferred stream to surface HTTP errors in _acompletion fallback path (#34627)	2026-08-04 22:44:43 +00:00
test_component_allowlists.py	fix(gateway): keep the Prometheus /metrics Mount in the gateway route trim (#32317)	2026-07-07 18:36:38 +03:00
test_cors_config.py
test_custom_proxy.py
test_dynamic_mcp_route.py	Litellm oss staging 040626 (#29671)	2026-06-04 11:07:20 -07:00
test_empty_model_list.py
test_enforce_user_param.py
test_fallback_management_endpoints.py
test_fastapi_offline_routes.py
test_filter_models_by_team_access_group.py	fix: resolve access group names in _filter_models_by_team_id (#25224)	2026-05-01 11:55:36 +05:30
test_health_check_functions.py	feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716)	2026-05-13 09:49:05 -07:00
test_health_check_max_tokens.py	fix: skip health check for semantic auto_router deployments (#31668)	2026-06-29 19:47:20 -07:00
test_langfuse_passthrough_security.py
test_lazy_openapi_snapshot.py	[Fix] Tests: Move Misplaced Import in Lazy OpenAPI Snapshot Test	2026-05-01 14:24:53 -07:00
test_litellm_pre_call_utils.py	fix(proxy): redact credential headers from request logging copies (#35678)	2026-08-04 00:07:05 +00:00
test_max_budget_env_var.py
test_mcp_asgi_response.py	fix(mcp): surface upstream 401 for token-forwarding MCP servers (#27847)	2026-05-13 12:03:36 -07:00
test_model_based_routing_files_batches.py	test(batches): move orphan tests into tests/test_litellm for CI coverage (#30510)	2026-06-16 10:20:59 -07:00
test_model_dump_with_preserved_fields.py
test_model_id_header_propagation.py	feat(proxy): add x-litellm-model-name response header with deployment model string (#33698)	2026-07-17 20:29:42 -07:00
test_model_info_default_limits.py	fix(proxy): align /v1/model/info with router deployments (#30025)	2026-06-10 19:38:21 -07:00
test_model_level_guardrails.py	fix(proxy): apply key/team router_settings.model_group_alias (#35486)	2026-08-03 22:09:47 +00:00
test_model_list_healthy_only.py	feat: litellm oss 110626 (#30202)	2026-06-11 22:30:26 -07:00
test_modify_response_streaming_passthrough.py	fix(proxy): use e.request_data for logging_obj in ModifyResponseException streaming passthrough (#30800)	2026-06-18 23:29:08 -07:00
test_openapi_schema_validation.py	fix(proxy): preserve HTTP operations when injecting WebSocket stubs into OpenAPI schema	2026-05-06 00:28:42 +02:00
test_plugin_routes.py	feat: litellm plugin architecture v2 (#30688)	2026-06-20 20:37:22 -07:00
test_pricing_field_strip.py	chore: litellm oss staging160626 (#30527)	2026-06-16 18:23:13 -07:00
test_prometheus_cleanup.py
test_provider_url_destination_guard.py	chore(proxy): clean up request parameter validation and provider destination handling (#34189)	2026-07-22 00:57:58 +00:00
test_proxy_cli.py	feat(proxy): bound DB statement and lock time via general_settings (#35496)	2026-08-01 13:54:17 -07:00
test_proxy_logging_hook_detection.py	fix(proxy): recognize inherited apply_guardrail overrides and keep masking guardrails on their own stream hook	2026-07-30 15:33:49 -07:00
test_proxy_server.py	fix(router): keep custom model_info across a price data reload (#35491)	2026-08-05 19:56:50 +00:00
test_proxy_types.py	fix(proxy): allow /key/update to identify the key by key_alias (#34851)	2026-07-29 09:48:08 -07:00
test_proxy_utils.py	fix(proxy): keep the connected DB client when a startup health check fails (#35837)	2026-08-05 12:27:49 -07:00
test_pyroscope.py	Implement normalize_nonempty_secret_str function to trim whitespace from secrets and treat empty values as unset. Update proxy_server to use this function for Grafana credentials. Enhance tests to validate the new normalization behavior.	2026-05-04 18:17:31 +00:00
test_read_model_list.py	feat: add minimal rust router + axum ai-gateway calling router.realtime (2/2) (#31135)	2026-06-23 19:16:34 -07:00
test_redis_auth_cache_flag.py	fix(proxy): share CLI SSO login sessions across workers without enable_redis_auth_cache (#33261)	2026-07-22 10:29:34 -07:00
test_response_model_sanitization.py	perf: eliminate per-request callback scanning on proxy hot path (#27858)	2026-05-14 09:28:31 -07:00
test_route_a2a_models.py
test_route_llm_request.py	fix(ci): let the E2E proxy accept the mock testing params its suite sends	2026-08-01 14:57:42 -07:00
test_sensitive_route_auth.py
test_shared_health_check.py	feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716)	2026-05-13 09:49:05 -07:00
test_spend_log_cleanup.py	feat(spend): rebuild the auto-router benchmarks backend as a per-session rollup (#35910)	2026-08-05 20:06:32 +00:00
test_swagger_chat_completions.py
test_team_member_update.py	feat(ui): add budget duration to edit team member form (#29717)	2026-06-06 17:24:55 -07:00
test_team_org_move.py
test_tools_allowlist_enforcement.py	fix(responses-bridge): custom tool round-trip and allowlist preservation for Codex CLI (#32258)	2026-07-06 17:34:27 -07:00
test_update_llm_router_resilience.py	fix(proxy): stop model writes 500ing on another pod's delete (#35400)	2026-07-31 18:10:48 -07:00