litellm/tests/test_litellm/proxy/pass_through_endpoints
Krish Dholakia 26fd6d5362
Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619)
* fix(unified_guardrails.py): send all chunks on completion of final stream

* feat(generic_guardrail_api.py): handle tool call response on streaming LLM responses

* fix(anthropic/chat/guardrail_translation): initial commit adding anthropic tool response streaming guardrails

enables guardrail checks on tool response from llm's to work via `/v1/messages`

* feat(anthropic/): working guardrail checks on tool response from LLMs

ensures guardrail checks on anthropic /v1/messages works as expected

* feat(responses/guardrail_translation): support tool call response guardrails on streaming for /v1/responses

ensures complete coverage of tool call responses

* refactor(openai.py): refactor to use consistent pydantic model for responses api tool response on streaming

enables non-openai model tool call response to work correctly with guardrail checks on /v1/responses

* test: update tests

* fix: fix linting error

* fix: fix failing tests

* fix: fix import errors

* fix(openai/chat/guardrail_transformation): fix final chunk returned on streaming
2025-12-15 18:19:52 +05:30
..
llm_provider_handlers Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) 2025-12-15 18:19:52 +05:30
test_llm_pass_through_endpoints.py fix bedrock passthrough auth issue (#16879) 2025-11-24 18:44:59 -08:00
test_pass_through_endpoints.py (feat) Milvus - search vector store support + (fix) Passthrough Endpoints - support multi-part form data on passthrough (#16035) 2025-11-01 12:00:29 -07:00
test_passthrough_endpoints_common_utils.py test fix location of encode bedrock runtime modelid arn 2025-08-22 17:34:09 -07:00
test_passthrough_guardrails.py [Feat] Add guardrails for pass through endpoints (#17221) 2025-11-27 12:06:53 -08:00
test_passthrough_guardrails_field_targeting.py chore: cleanup unused scripts and fix misplaced test file (#17611) 2025-12-08 19:00:55 -08:00
test_vertex_ai_batch_passthrough.py Litellm sameer oct staging (#15806) 2025-10-24 12:17:22 -07:00