devin-ai-integration[bot] 24123269cc fix(guardrails): resolve judge_model credentials via lazy Router lookup in llm_as_a_judge (#34509) ... * fix(guardrails): resolve judge_model credentials via Router in llm_as_a_judge Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(guardrails): wire llm_router into DB-backed judge guardrail init paths Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * test(guardrails): assert patch endpoint forwards llm_router to sync Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * refactor(guardrails): resolve judge Router lazily and fix wildcard/alias dispatch Resolve the proxy Router at judge-call time via an injected provider instead of capturing it at construction, so a DB-backed judge guardrail created before the Router exists no longer captures None permanently. Select the Router path with router.get_model_list(model_name=judge_model) so wildcard routes and model_group_alias keys resolve, not just literal deployment names. Isolate the judge call from user-traffic routing with num_retries=0 and fallbacks=[]. Revert the llm_router threading through the DB sync/reinit/create/approve/patch paths since the lazy provider makes it unnecessary. Replace mocked-Router tests with real Router coverage for plain deployments, model_group_alias, and wildcard routes, plus lazy per-call resolution. Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(guardrails): harden judge verdict parsing and guard proxy import Strip markdown fences and surrounding prose before json.loads so fencing-prone judge models evaluate instead of failing open, guard the proxy_server import in _default_router_provider so an unimportable proxy falls back to the SDK, and snapshot/restore global callback lists in the DB-path judge registry tests Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(guardrails): reject non-object judge verdicts instead of failing open as success * fix(guardrails): route hidden model_group_alias judge models through the Router --------- Co-authored-by: milan <milan@berri.ai> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: yucheng-berri <yucheng@berri.ai>		2026-07-25 20:16:43 -07:00
..
_experimental/mcp_server	Merge pull request #34265 from BerriAI/litellm_lit4339_upstream_resource	2026-07-25 18:53:45 -07:00
a2a	fix(a2a): reject malformed protocolVersion suffixes while keeping semver prereleases	2026-07-21 13:24:58 -07:00
agent_endpoints	fix(a2a): reject malformed protocolVersion suffixes while keeping semver prereleases	2026-07-21 13:24:58 -07:00
anthropic_endpoints	feat: litellm oss staging (#31935)	2026-07-03 09:27:31 +05:30
auth	fix(auth): route JWT default-team into memberships instead of the create payload (#33082)	2026-07-25 11:37:11 -07:00
batches_endpoints	refactor(proxy/batches): make managed-file resolution purely additive, fall back like base (#34584)	2026-07-24 18:42:48 -07:00
client	fix(autoroute): discover models via /v1/models so an AI-API-only key works (#34259)	2026-07-22 20:50:14 -07:00
common_utils	fix(proxy): global max_budget ignores budget_duration; enforce against the resettable proxy budget row (#33732)	2026-07-25 11:29:39 -07:00
config_resolvers	feat(proxy): add SAML 2.0 SSO for the admin UI (#31429)	2026-07-24 12:51:28 -07:00
db	feat(spend): track prompt compression saved tokens in daily spend aggregates (#33810)	2026-07-18 17:47:54 -07:00
discovery_endpoints	chore: litellm oss staging160626 (#30527)	2026-06-16 18:23:13 -07:00
enterprise_billing	feat(proxy): push-based OTLP billable-request metering for enterprise deployments (#31592)	2026-07-15 12:12:52 -07:00
experimental/mcp_server
google_endpoints	chore: litellm oss staging160626 (#30527)	2026-06-16 18:23:13 -07:00
guardrails	fix(guardrails): resolve judge_model credentials via lazy Router lookup in llm_as_a_judge (#34509)	2026-07-25 20:16:43 -07:00
health_endpoints	fix(proxy): authorize /health/test_connection against loaded deployment's team_id (VERIA-441) (#31767)	2026-07-01 17:05:49 -07:00
hooks	fix(proxy): hash caller-supplied key in key update audit log object_id (#34632)	2026-07-25 10:45:51 -07:00
image_endpoints	fix(proxy): extend response headers hook to streaming, TTS, image gen, and pass-through (#24232)	2026-06-09 22:10:23 +02:00
logging_endpoints	feat(proxy): add POST /v1/callbacks/logs to replay logging payloads through callbacks (#31134)	2026-06-24 15:25:10 -07:00
management_endpoints	Merge pull request #34265 from BerriAI/litellm_lit4339_upstream_resource	2026-07-25 18:53:45 -07:00
management_helpers	fix(proxy): restore atomic user upsert when adding team members (#34457)	2026-07-24 02:22:34 +00:00
memory	Litellm memory improvements v2 (#26541)	2026-04-25 19:03:43 -07:00
middleware	feat(proxy): push-based OTLP billable-request metering for enterprise deployments (#31592)	2026-07-15 12:12:52 -07:00
openai_files_endpoint	fix(vertex/files): stream OpenAI->Vertex batch JSONL uploads (#31036)	2026-06-24 13:19:57 -07:00
pass_through_endpoints	fix(passthrough): honor the zero fallback and aggregate-only TPM usage	2026-07-24 18:49:41 -07:00
policy_engine	fix(policies): reject non-existent team/key/model scope entries on attachment create (#32131)	2026-07-04 11:58:29 -07:00
prompts	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
proxy_server	feat(mcp): gateway DCR session admission at the aggregate /mcp endpoint (LIT-3637)	2026-07-23 00:24:28 -07:00
public_endpoints	fix(agents): allow optional securityScheme fields so /public/agent_hub does not 500 (#33897)	2026-07-20 18:13:09 -07:00
rag_endpoints	fix(rag): track LLM completion usage and spend for /v1/rag/query (#32438)	2026-07-17 17:45:27 +00:00
realtime_endpoints	chore: litellm oss 170626 (#30637)	2026-06-17 21:11:12 -07:00
response_api_endpoints	Litellm websocket improvements (#29563)	2026-06-03 11:48:35 -07:00
shutdown	feat(proxy): native /health/drain preStop hook for graceful shutdown (#29439)	2026-06-02 16:30:44 -07:00
spend_tracking	fix(spend_tracking): populate cache_creation_input_tokens for Responses API logs	2026-07-23 19:07:09 -07:00
test_configs
types_utils	fix(proxy): resolve router_settings.plugins dotted paths and load plugins from installed packages (#33644)	2026-07-17 11:23:18 -07:00
ui_crud_endpoints	feat(proxy): add SAML 2.0 SSO for the admin UI (#31429)	2026-07-24 12:51:28 -07:00
utils	fix(proxy): merge model-level guardrails before pre_call_hook (#29654)	2026-07-25 10:16:59 -07:00
vector_store_endpoints	test(vector_store): update credential resolution assertion for team_id kwarg	2026-07-18 18:41:12 +00:00
video_endpoints	test(videos): add 1:1 test file scaffold for videos component paths (#30631)	2026-06-29 09:12:51 +05:30
__init__.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
conftest.py	fix(proxy): recover Prisma DB reconnect loop when client is disconnected	2026-07-07 09:50:27 +03:00
test_aiohttp_cleanup_closed.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_aiohttp_session_recovery.py	fix: use AsyncMock for concurrent test consistency	2026-03-18 00:54:23 +00:00
test_api_key_masking_in_errors.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_audio_speech_prometheus_hooks.py	fix(proxy): extend response headers hook to streaming, TTS, image gen, and pass-through (#24232)	2026-06-09 22:10:23 +02:00
test_batch_expiry.py	fix(proxy): strip LiteLLM policy tracking from OpenAI batch metadata (#28425)	2026-05-26 11:35:42 -07:00
test_batch_metadata_none_fix.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_batch_retrieve_bedrock.py	fix(proxy/batches): forward model to retrieve_batch for bedrock	2026-04-29 22:48:03 +02:00
test_batch_x_litellm_model_encoding.py	test(batches): move orphan tests into tests/test_litellm for CI coverage (#30510)	2026-06-16 10:20:59 -07:00
test_blocked_response_usage.py	feat: litellm oss staging (#31935)	2026-07-03 09:27:31 +05:30
test_budget_reservation.py	fix(proxy): reject failed atomic budget reservations under fail_closed_budget_enforcement (#34429)	2026-07-23 23:57:37 +00:00
test_caching_routes.py	Litellm oss staging 040626 (#29671)	2026-06-04 11:07:20 -07:00
test_chat_completion_metadata.py
test_common_request_processing.py	feat(complexity-router): add return_raw_model_name toggle for response model field (#33875)	2026-07-18 19:24:56 -07:00
test_component_allowlists.py	fix(gateway): keep the Prometheus /metrics Mount in the gateway route trim (#32317)	2026-07-07 18:36:38 +03:00
test_cors_config.py	refactor: extract _get_cors_config() for testability, fix no-op CORS tests	2026-04-11 22:24:04 +05:30
test_custom_proxy.py
test_dynamic_mcp_route.py	Litellm oss staging 040626 (#29671)	2026-06-04 11:07:20 -07:00
test_empty_model_list.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_enforce_user_param.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_fallback_management_endpoints.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_fastapi_offline_routes.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_filter_models_by_team_access_group.py	fix: resolve access group names in _filter_models_by_team_id (#25224)	2026-05-01 11:55:36 +05:30
test_health_check_functions.py	feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716)	2026-05-13 09:49:05 -07:00
test_health_check_max_tokens.py	fix: skip health check for semantic auto_router deployments (#31668)	2026-06-29 19:47:20 -07:00
test_langfuse_passthrough_security.py	chore(callbacks): guard dynamic integration hosts	2026-04-30 14:27:19 -07:00
test_lazy_openapi_snapshot.py	[Fix] Tests: Move Misplaced Import in Lazy OpenAPI Snapshot Test	2026-05-01 14:24:53 -07:00
test_litellm_pre_call_utils.py	feat(proxy): add overwrite_user_with_key_hash to stamp outgoing user param with key hash (#34417)	2026-07-23 16:38:01 -07:00
test_max_budget_env_var.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_mcp_asgi_response.py	fix(mcp): surface upstream 401 for token-forwarding MCP servers (#27847)	2026-05-13 12:03:36 -07:00
test_model_based_routing_files_batches.py	test(batches): move orphan tests into tests/test_litellm for CI coverage (#30510)	2026-06-16 10:20:59 -07:00
test_model_dump_with_preserved_fields.py
test_model_id_header_propagation.py	feat(proxy): add x-litellm-model-name response header with deployment model string (#33698)	2026-07-17 20:29:42 -07:00
test_model_info_default_limits.py	fix(proxy): align /v1/model/info with router deployments (#30025)	2026-06-10 19:38:21 -07:00
test_model_level_guardrails.py	fix(proxy): merge model-level guardrails before pre_call_hook (#29654)	2026-07-25 10:16:59 -07:00
test_model_list_healthy_only.py	feat: litellm oss 110626 (#30202)	2026-06-11 22:30:26 -07:00
test_modify_response_streaming_passthrough.py	fix(proxy): use e.request_data for logging_obj in ModifyResponseException streaming passthrough (#30800)	2026-06-18 23:29:08 -07:00
test_openapi_schema_validation.py	fix(proxy): preserve HTTP operations when injecting WebSocket stubs into OpenAPI schema	2026-05-06 00:28:42 +02:00
test_plugin_routes.py	feat: litellm plugin architecture v2 (#30688)	2026-06-20 20:37:22 -07:00
test_pricing_field_strip.py	chore: litellm oss staging160626 (#30527)	2026-06-16 18:23:13 -07:00
test_prometheus_cleanup.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_provider_url_destination_guard.py	chore(proxy): clean up request parameter validation and provider destination handling (#34189)	2026-07-22 00:57:58 +00:00
test_proxy_cli.py	chore(ci): merge oss branch (#33784)	2026-07-17 23:22:13 +00:00
test_proxy_logging_hook_detection.py	perf: reduce per-request and per-chunk overhead across Anthropic streaming hot paths (#28289)	2026-05-23 12:15:59 -07:00
test_proxy_server.py	fix(proxy): global max_budget ignores budget_duration; enforce against the resettable proxy budget row (#33732)	2026-07-25 11:29:39 -07:00
test_proxy_types.py	fix(router): apply team/key enable_tag_filtering to tag routing (#33436)	2026-07-16 14:41:24 -07:00
test_proxy_utils.py	fix(autoroute): discover models via /v1/models so an AI-API-only key works (#34259)	2026-07-22 20:50:14 -07:00
test_pyroscope.py	Implement normalize_nonempty_secret_str function to trim whitespace from secrets and treat empty values as unset. Update proxy_server to use this function for Grafana credentials. Enhance tests to validate the new normalization behavior.	2026-05-04 18:17:31 +00:00
test_read_model_list.py	feat: add minimal rust router + axum ai-gateway calling router.realtime (2/2) (#31135)	2026-06-23 19:16:34 -07:00
test_redis_auth_cache_flag.py	fix(proxy): share CLI SSO login sessions across workers without enable_redis_auth_cache (#33261)	2026-07-22 10:29:34 -07:00
test_response_model_sanitization.py	perf: eliminate per-request callback scanning on proxy hot path (#27858)	2026-05-14 09:28:31 -07:00
test_route_a2a_models.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00
test_route_llm_request.py	fix(proxy): return 400 instead of 500 for chat completions without messages	2026-07-24 20:32:09 +00:00
test_sensitive_route_auth.py	chore(proxy): guard sensitive public endpoints	2026-04-30 11:52:47 -07:00
test_shared_health_check.py	feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716)	2026-05-13 09:49:05 -07:00
test_spend_log_cleanup.py	test(proxy): cover the cleanup run-loop backstop branch	2026-07-24 17:43:15 -07:00
test_swagger_chat_completions.py	fix(proxy): avoid misleading multi-method operation ids	2026-04-30 20:44:14 -07:00
test_team_member_update.py	feat(ui): add budget duration to edit team member form (#29717)	2026-06-06 17:24:55 -07:00
test_team_org_move.py	fix(team_endpoints): auto-add SSO team members to org on move (proxy admin only) (#26377)	2026-04-24 08:36:25 -07:00
test_tools_allowlist_enforcement.py	fix(responses-bridge): custom tool round-trip and allowlist preservation for Codex CLI (#32258)	2026-07-06 17:34:27 -07:00
test_update_llm_router_resilience.py	style: run black formatter on files from main merge	2026-04-17 13:02:59 -07:00