litellm/tests/e2e/guardrails
devin-ai-integration[bot] 1dbde0845e
test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758)
* test: move guardrails, image, audio, batches, search legacy tests to unit

* test: restore the custom guardrail and remaining chunk 1 unit rows

* test: move the ocr matrix to e2e

* test: drop comments from moved tests and fix vertex ocr credentials

* test: move litellm utils and unified google legacy tests to their tiers

* test: move logging callback and pass-through unit legacy tests to their tiers

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test: move store_model_in_db legacy tests and start the admin ui migration

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

* test: finish the proxy job rows and drop their CircleCI jobs

Moves the remaining multi-instance, openai endpoint, otel, pass-through and
top-level proxy tests into tests/integration with scripted upstreams, rewrites
the weak replacements to assert the outbound wire and exact responses, and
removes the build_and_test job group this PR owns from CircleCI

* test: tighten the key generation and error log assertions, rename migrated unit files to their mapped names

* test: shard the pagerduty unit tests and record the rust harness file on the coverage allowlist

* test: drive the SSO sign-in tests through a scripted IdP and isolate the cost center stand-in

* test: type the e2e beta header, prompt cache and secret manager values

* test: assert the missing model error message on the OpenAI routes

* test: drop the deleted otel base class import and restore mcp redaction and exact langfuse usage checks

* test: make the langfuse fixture directory a package for the layout check

* test: restore collected no-match cases, real langfuse and gcs payload checks, and gate the aws secret lane

* test: keep the ocr e2e pdf fixture next to the test

* test: put meta below covers on the streaming tool search e2e

* test: run the OCR matrix against a scripted upstream and fix two runner-only e2e failures

* test: count only OCR calls in the OCR matrix recorder

* test: pin OCR parse bodies and billed cost, group new e2e cases into classes

* ci: restore the python image anchor dropped in the main sync

---------

Co-authored-by: yuneng <yuneng@berri.ai>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-10-11 00:17:21 -07:00
..
conftest.py test(true_rabbit): cover passthrough headers, batch assume-role, gemini, vllm, bedrock guardrails, batch rate-limit mapping (#33843) 2026-07-20 16:15:55 -07:00
guardrails_client.py test(e2e): record steps for raw transport calls and poll helpers (#45150) 2026-10-07 15:21:26 -07:00
test_apply_guardrail_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_bedrock_guardrail_e2e.py test: migrate SDK and proxy-booting legacy CircleCI tests to their tiers (#45758) 2026-10-11 00:17:21 -07:00
test_block_code_execution_guardrail_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_guardrail_dispatch_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_guardrail_information_response_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_key_guardrail_image_edit_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_key_guardrail_video_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_openai_moderation_category_matrix_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_openai_moderation_guardrail_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_policy_inherited_guardrail_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_presidio_masking_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_responses_pre_call_block_stream_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_streaming_guardrail_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_team_disable_global_guardrail_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00
test_tool_permission_guardrail_e2e.py test(e2e): tag guardrails and logging tests with Subject metadata and record client steps (#44963) 2026-10-07 10:32:25 -07:00