devin-ai-integration[bot] 52403d7a8d fix(jwt): retry JWKS fetches, serve stale keys, and return 503 when the IdP is unreachable (#37690) ... A JWKS fetch had no retry, so a single connect timeout to the identity provider failed authentication outright, and once the cached copy expired there was nothing to fall back on. How that surfaced depended on the outage shape: httpx.ConnectTimeout was missing from DB_CONNECTION_ERROR_TYPES so it fell through to the generic auth handler as a 401 with an empty detail, while a read timeout took the database path and reported a healthy database as unreachable. Transport failures are now retried three times with a short backoff, and the last-known-good JWKS stays usable for a bounded window past public_key_ttl. That window is public_key_stale_ttl, a new config field defaulting to 3600s and settable to 0 to fail closed. It is checked on every read against the current setting rather than baked into the cache entry when it is written, so lowering it binds immediately instead of waiting for entries written under the old value to age out, which matters because a shared cache survives the restart an operator performs to make the change take effect. A copy whose write time cannot be established is not servable. Only httpx.TransportError unlocks the stale copy, so an identity provider that answers at all, including with a narrowed key set, revokes on the next refresh. Every stale serve logs the kid it authenticated, how long ago that copy was refreshed, and how long until it stops being trusted. A sustained outage is remembered for 30s per key url, so it costs one fetch per window instead of three timeouts per request serialised behind the refresh lock. Non-200 JWKS responses now raise instead of being cached as the key set, which previously let an error body overwrite the last-known-good copy. An unreachable identity provider with no cached copy left returns 503 auth_provider_unavailable. Resolves LIT-5524 Co-authored-by: Yassin Kortam <yassin@berri.ai>		2026-08-20 16:41:06 -07:00
..
_experimental/mcp_server	fix(mcp): let a salt-key-orphaned OAuth credential be replaced by re-authorization (#37672)	2026-08-20 14:11:17 -07:00
a2a	fix(a2a): reject malformed protocolVersion suffixes while keeping semver prereleases	2026-07-21 13:24:58 -07:00
agent_endpoints	fix(a2a): return SSE (text/event-stream) for message/stream instead of NDJSON (#35037)	2026-08-20 16:19:58 -07:00
analytics_endpoints	feat(ui): split failed requests into their own series on the cache dashboard (#34862)	2026-07-29 09:48:17 -07:00
anthropic_endpoints	fix(proxy): estimate failed-request input tokens on /v1/messages and count system prompts	2026-08-18 14:21:47 -07:00
auth	fix(jwt): retry JWKS fetches, serve stale keys, and return 503 when the IdP is unreachable (#37690)	2026-08-20 16:41:06 -07:00
batches_endpoints	Merge pull request #37198 from BerriAI/litellm_lit5660_batches_limit_400	2026-08-17 15:53:46 -07:00
client	Merge origin/litellm_internal_staging into litellm_cli_refresh_tokens	2026-08-20 10:54:48 -07:00
common_utils	fix(reset_budget_job): reconnect and retry on transient DB transport errors (#37705)	2026-08-20 16:02:51 -07:00
config_resolvers	feat(proxy): add SAML 2.0 SSO for the admin UI (#31429)	2026-07-24 12:51:28 -07:00
credential_endpoints	fix(proxy): return the real status code when a credential update is rejected (#36166)	2026-08-07 08:02:52 +00:00
db	fix(jwt): retry JWKS fetches, serve stale keys, and return 503 when the IdP is unreachable (#37690)	2026-08-20 16:41:06 -07:00
discovery_endpoints	test: remove tests that never execute	2026-08-12 10:45:38 -07:00
enterprise_billing	feat(proxy): push-based OTLP billable-request metering for enterprise deployments (#31592)	2026-07-15 12:12:52 -07:00
experimental/mcp_server
fine_tuning_endpoints	fix(proxy): authenticate managed ids before routing	2026-08-08 02:42:34 -07:00
google_endpoints	chore: litellm oss staging160626 (#30527)	2026-06-16 18:23:13 -07:00
guardrails	fix(a2a): return SSE (text/event-stream) for message/stream instead of NDJSON (#35037)	2026-08-20 16:19:58 -07:00
health_endpoints	feat(proxy): auto-suppress the no-Redis banner for confirmed single-worker deployments	2026-08-14 17:11:05 -07:00
hooks	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_batch_enqueued_token_limit	2026-08-19 19:31:46 -07:00
image_endpoints	fix(proxy)!: share one destination check between body and path-supplied model	2026-08-05 15:17:43 -07:00
logging_endpoints	feat(proxy): add POST /v1/callbacks/logs to replay logging payloads through callbacks (#31134)	2026-06-24 15:25:10 -07:00
management_endpoints	feat(sso): source generic OIDC user claims from ID/access token when UserInfo is incomplete (#37696)	2026-08-20 16:20:47 -07:00
management_helpers	feat(proxy)!: default audit logs on for enterprise licenses (#37518)	2026-08-19 18:49:21 -07:00
memory	fix(proxy): give proxy_admin_viewer read parity with proxy_admin (#35851)	2026-08-05 18:33:55 +00:00
middleware	feat(proxy): add Amazon Comprehend Medical passthrough provider	2026-08-17 15:44:06 -07:00
ocr_endpoints	fix(ocr): validate body req_format in the proxy endpoint and run its tests in CI	2026-08-17 18:29:35 +00:00
openai_files_endpoint	feat(proxy): redact or drop individual batch records instead of rejecting the file (#37561)	2026-08-20 13:12:55 -07:00
pass_through_endpoints	fix: harden vertex live passthrough against client model forms and dict credentials	2026-08-20 03:05:48 -07:00
policy_engine	fix(guardrails): scan text on /guardrails/apply_guardrail for Azure Content Safety (#36894)	2026-08-17 11:18:40 -07:00
prompts	fix(proxy): give proxy_admin_viewer read parity with proxy_admin (#35851)	2026-08-05 18:33:55 +00:00
proxy_server	fix(token_counter): stop large token counts from blocking the proxy event loop (#37697)	2026-08-20 16:09:07 -07:00
public_endpoints	fix(ui): distinguish hosted and local vLLM in the provider dropdown	2026-08-14 13:39:37 -07:00
rag_endpoints	fix(rag): track LLM completion usage and spend for /v1/rag/query (#32438)	2026-07-17 17:45:27 +00:00
realtime_endpoints	fix(realtime): bound Vertex credential resolution and make realtime failures loud	2026-08-20 02:02:00 -07:00
response_api_endpoints	fix(responses_api): map bridged chat usage on guardrail-blocked replies	2026-08-14 17:04:27 -07:00
shutdown
spend_tracking	test: add six ruff rules that catch tests which cannot fail (#37709)	2026-08-20 14:21:26 -07:00
test_configs
types_utils	fix(proxy): resolve router_settings.plugins dotted paths and load plugins from installed packages (#33644)	2026-07-17 11:23:18 -07:00
ui_crud_endpoints	feat(ui): let admins supply a dark-mode variant of their custom logo (#37662)	2026-08-20 12:48:55 -07:00
utils	Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_azure_postgres_entra_auth	2026-08-20 13:50:19 -07:00
vector_store_endpoints	test: run the 30 test files stranded in the second mirror (#37595)	2026-08-20 10:59:43 -07:00
vector_store_files_endpoints	fix(proxy): authenticate managed ids before routing	2026-08-08 02:42:34 -07:00
video_endpoints	test(videos): add 1:1 test file scaffold for videos component paths (#30631)	2026-06-29 09:12:51 +05:30
__init__.py
conftest.py	test(proxy): stop monkeypatch.undo re-planting fixture-mocked prisma_client	2026-08-13 20:11:06 -07:00
test_aiohttp_cleanup_closed.py
test_aiohttp_session_recovery.py
test_api_key_masking_in_errors.py
test_audio_speech_prometheus_hooks.py
test_batch_expiry.py
test_batch_metadata_none_fix.py
test_batch_retrieve_bedrock.py
test_batch_x_litellm_model_encoding.py	test(proxy): give the x-litellm-model fallback test deterministic openai env creds	2026-08-17 12:42:57 -07:00
test_blocked_response_usage.py	fix(responses_api): map bridged chat usage on guardrail-blocked replies	2026-08-14 17:04:27 -07:00
test_budget_reservation.py	perf(budget_reservation): tokenize each request once, off the event loop for large prompts (#37683)	2026-08-20 16:07:38 -07:00
test_caching_routes.py
test_chat_completion_metadata.py
test_claude_code_marketplace.py	test: run the 30 test files stranded in the second mirror (#37595)	2026-08-20 10:59:43 -07:00
test_common_request_processing.py	ci: lint the test tree for undefined names and fix all 30 (#37671)	2026-08-20 13:30:34 -07:00
test_component_allowlists.py	feat(proxy): authenticate to Azure Postgres with Microsoft Entra ID tokens	2026-08-20 11:50:16 -07:00
test_conftest.py	test(proxy): stop monkeypatch.undo re-planting fixture-mocked prisma_client	2026-08-13 20:11:06 -07:00
test_cors_config.py
test_custom_proxy.py
test_dynamic_mcp_route.py	fix(proxy): serve aggregate MCP endpoint on bare /mcp instead of 307-redirecting (#34845)	2026-08-14 17:04:32 -07:00
test_empty_model_list.py
test_enforce_user_param.py
test_fallback_management_endpoints.py
test_fastapi_offline_routes.py
test_filter_models_by_team_access_group.py
test_health_check_functions.py
test_health_check_max_tokens.py	fix: skip health check for semantic auto_router deployments (#31668)	2026-06-29 19:47:20 -07:00
test_init_litellm_callbacks.py	test: run the 30 test files stranded in the second mirror (#37595)	2026-08-20 10:59:43 -07:00
test_langfuse_passthrough_security.py
test_lazy_openapi_snapshot.py	feat(proxy): add GET /v1/indexes to list vector store indexes (#36289)	2026-08-10 15:09:59 -07:00
test_litellm_pre_call_utils.py	fix(proxy): stop leaking the client_side_timeout marker to providers	2026-08-18 13:37:07 -07:00
test_max_budget_env_var.py
test_mcp_asgi_response.py
test_model_based_routing_files_batches.py	test(batches): move orphan tests into tests/test_litellm for CI coverage (#30510)	2026-06-16 10:20:59 -07:00
test_model_deprecations_endpoint.py	refactor(proxy): tighten model deprecation typing and cover the endpoint	2026-08-10 22:58:35 +00:00
test_model_dump_with_preserved_fields.py
test_model_id_header_propagation.py	feat(proxy): add x-litellm-model-name response header with deployment model string (#33698)	2026-07-17 20:29:42 -07:00
test_model_info_default_limits.py
test_model_level_guardrails.py	fix(proxy): apply key/team router_settings.model_group_alias (#35486)	2026-08-03 22:09:47 +00:00
test_model_list_healthy_only.py	feat: litellm oss 110626 (#30202)	2026-06-11 22:30:26 -07:00
test_modify_response_streaming_passthrough.py	fix(proxy): use e.request_data for logging_obj in ModifyResponseException streaming passthrough (#30800)	2026-06-18 23:29:08 -07:00
test_openai_ws_passthrough_routes.py	fix(proxy): close websocket cleanly when OpenAI credentials are missing	2026-08-16 14:40:37 -07:00
test_openapi_schema_validation.py
test_plugin_routes.py	feat: litellm plugin architecture v2 (#30688)	2026-06-20 20:37:22 -07:00
test_pricing_field_strip.py	fix(guardrails): bill all chunks on mid-chunking block, strip client guardrail cost metadata, add cost map schema keys	2026-08-18 14:52:23 -07:00
test_prisma_engine_watchdog.py	test: run the 30 test files stranded in the second mirror (#37595)	2026-08-20 10:59:43 -07:00
test_prisma_migration.py	fix(proxy): fail the standalone prisma migration entrypoint on migration errors (#37692)	2026-08-20 16:20:27 -07:00
test_prometheus_cleanup.py
test_provider_url_destination_guard.py	fix(proxy)!: share one destination check between body and path-supplied model	2026-08-05 15:17:43 -07:00
test_proxy_cli.py	feat(proxy): authenticate to Azure Postgres with Microsoft Entra ID tokens	2026-08-20 11:50:16 -07:00
test_proxy_logging_hook_detection.py	fix(guardrails): scan text on /guardrails/apply_guardrail for Azure Content Safety (#36894)	2026-08-17 11:18:40 -07:00
test_proxy_server.py	fix: gate guardrail read-through to active rows and serialize it with the reload reconcile	2026-08-19 01:46:33 -07:00
test_proxy_types.py	feat(proxy): add project-level ITPM and OTPM quotas	2026-08-05 12:53:22 +05:30
test_proxy_utils.py	fix(proxy): strip client standard_logging_object before the failure logging handler	2026-08-19 16:53:02 -07:00
test_pyroscope.py
test_read_model_list.py	feat: add minimal rust router + axum ai-gateway calling router.realtime (2/2) (#31135)	2026-06-23 19:16:34 -07:00
test_redis_auth_cache_flag.py	test: add six ruff rules that catch tests which cannot fail (#37709)	2026-08-20 14:21:26 -07:00
test_response_model_sanitization.py
test_route_a2a_models.py	fix(proxy): single-row read-through resyncs and reload-race hardening	2026-08-18 21:02:12 -07:00
test_route_llm_request.py	fix(proxy): serialize read-through with reloads, gate db object types	2026-08-18 22:43:44 -07:00
test_sensitive_route_auth.py
test_shared_health_check.py
test_spend_log_cleanup.py	feat(proxy): add maximum_health_check_retention_period to bound the health-check table (#37681)	2026-08-20 16:01:16 -07:00
test_swagger_chat_completions.py
test_team_member_update.py
test_team_org_move.py
test_tools_allowlist_enforcement.py	fix(responses-bridge): custom tool round-trip and allowlist preservation for Codex CLI (#32258)	2026-07-06 17:34:27 -07:00
test_update_llm_router_resilience.py	feat(complexity_router): custom classifier plugins via classifier_type 'custom' (#37249)	2026-08-18 14:09:19 -07:00