litellm/tests/e2e/ui/tests
devin-ai-integration[bot] e26a6450c8
test(integration): add MCP gateway coverage wave 1 with a dedicated mcp shard and proxy coverage artifact (#42711)
* test(integration): drop the contracts.json manifest and the covers requirement

Groups live as a GROUPS literal in run.py, the browser expectations move next to the
browser tests, and the runner fails only on pytest failure, collection errors or a
selected file that collects zero tests. The covers marker stays registered for the
existing tests but is no longer checked. The mcp directory gets its own group

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* ci(integration): run mcp as its own shard with xdist and a peer proxy

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* ci(integration): INTEGRATION_COVERAGE=1 runs the proxy under coverage for the MCP modules

The mcp shard sets it. The proxy and its peer start under coverage run in parallel mode,
get SIGTERM after the tests so coverage flushes, and the combined text and HTML reports
land in the suite results that CircleCI already stores as artifacts

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* ci(integration): let the test proxy flush coverage when uvicorn re-raises SIGTERM

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test(integration): add SSE, stdio, scripted, OpenAPI and OAuth 2.1 MCP peer doubles

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test(integration): add MCP transport and access-control matrices

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test(integration): add MCP credential and OAuth flow coverage

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test(integration): add MCP LLM endpoint, accounting, guardrail, resilience and lifecycle coverage

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test(integration): stop the same-URL grant test from counting a late initialize as a leaked call and satisfy the test-tree lint

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test(integration): assert the REST denied-server listing is refused or empty

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test(integration): pin the REST denied-server listing to 403 access_denied

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

---------

Co-authored-by: yuneng <yuneng@berri.ai>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-23 07:48:46 -07:00
..
auth fix(e2e/ui): resolve dashboard base URL from env instead of hardcoding localhost (#34739) 2026-07-27 10:19:32 -07:00
budgets test(e2e/ui): wait for the filtered budget list before clicking a row action 2026-09-17 21:39:22 -07:00
guardrails test(e2e): wait for serving propagation in UI journeys 2026-09-11 10:25:43 -07:00
integrationCritical test(integration): add MCP gateway coverage wave 1 with a dedicated mcp shard and proxy coverage artifact (#42711) 2026-09-23 07:48:46 -07:00
internal-user fix(e2e): expect models filters to persist after reload 2026-09-15 18:21:43 -07:00
internal-viewer test(e2e): assert user-observable behavior instead of DOM structure 2026-08-31 14:04:15 -07:00
login fix(e2e/ui): resolve dashboard base URL from env instead of hardcoding localhost (#34739) 2026-07-27 10:19:32 -07:00
logs fix(ui): paginate request logs by session groups server-side (#39257) 2026-09-02 17:54:17 -07:00
mcp test(e2e-ui): check the MCP Tools tab against the upstream's own tools/list (#42397) 2026-09-21 20:35:30 -07:00
migration test(ui): assert navigation through accessible links and page content 2026-09-06 00:59:18 -07:00
modelHub style: drop explanatory comments from the agent publish fix 2026-09-03 04:27:43 -07:00
modelsPage test(e2e): drop the auto-router select "opens below" spec 2026-09-16 22:43:51 -07:00
navigation test(ui): assert navigation through accessible links and page content 2026-09-06 00:59:18 -07:00
playground test(e2e/ui): address the migrated dashboard controls by role, not antd classes 2026-08-15 15:37:09 -07:00
prompts test(ui): address review feedback 2026-09-17 23:46:53 -07:00
proxy-admin fix(e2e): onboard dashboard fixtures through invitations 2026-09-15 17:44:18 -07:00
settings test(e2e): drop redundant SCIM key cleanup, the throwaway db is the teardown 2026-08-31 15:36:35 -07:00
tables test: repair two CI tests broken by intentional changes 2026-09-05 12:02:48 -07:00
tagManagement test(ui): address review feedback 2026-09-17 23:46:53 -07:00
team-admin fix(e2e): onboard dashboard fixtures through invitations 2026-09-15 17:44:18 -07:00
usage test(e2e/ui): cover the Usage page activity tabs (#39061) 2026-09-01 12:36:17 -07:00
users test(e2e): match the Internal Users search placeholder shipped by #39604 2026-09-03 16:57:10 -07:00