scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-02 02:11:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 147
litellm/litellm/integrations
History
Krish Dholakia 26fd6d5362
Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) 
* fix(unified_guardrails.py): send all chunks on completion of final stream

* feat(generic_guardrail_api.py): handle tool call response on streaming LLM responses

* fix(anthropic/chat/guardrail_translation): initial commit adding anthropic tool response streaming guardrails

enables guardrail checks on tool response from llm's to work via `/v1/messages`

* feat(anthropic/): working guardrail checks on tool response from LLMs

ensures guardrail checks on anthropic /v1/messages works as expected

* feat(responses/guardrail_translation): support tool call response guardrails on streaming for /v1/responses

ensures complete coverage of tool call responses

* refactor(openai.py): refactor to use consistent pydantic model for responses api tool response on streaming

enables non-openai model tool call response to work correctly with guardrail checks on /v1/responses

* test: update tests

* fix: fix linting error

* fix: fix failing tests

* fix: fix import errors

* fix(openai/chat/guardrail_transformation): fix final chunk returned on streaming
2025-12-15 18:19:52 +05:30
..
_types Support responses API streaming in langfuse otel (#16153) 2025-11-02 09:36:34 -08:00
agentops Add AgentOps Integration to LiteLLM (#9685) 2025-04-22 10:29:01 -07:00
arize [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
azure_storage fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
bitbucket [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
cloudzero [Bug] Updated spend would not be sent to CloudZero (#16201) 2025-11-10 19:43:15 -08:00
datadog Fix: Datadog callback regression when ddtrace is installed (#17393) 2025-12-02 17:27:50 -08:00
deepeval fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
dotprompt [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
email_templates [Feat] Email Notifications - Ensure Users get Key Rotated Email (#16292) 2025-11-05 15:56:49 -08:00
gcs_bucket fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
gcs_pubsub Fix gcs pub sub logging with env var GCS_PROJECT_ID (#10042) 2025-04-15 21:50:48 -07:00
generic_api Native Webhook Integration Sumologic (#17630) 2025-12-07 23:23:39 -08:00
generic_prompt_management Prompt Management - new API for integrating providers (#17829) 2025-12-11 15:43:40 -08:00
gitlab [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
langfuse [Fix] CI/CD - Fix failing proxy unit test and langfuse trace_id test (#17924) 2025-12-13 09:32:43 -08:00
opentelemetry_utils [Feat] s3 logger, add support for ssl_verify when using minio logger (#16211) 2025-11-03 13:56:00 -08:00
opik fix Tuple 2025-11-06 16:19:10 -08:00
prometheus_helpers (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
SlackAlerting Fix/organization max budget not enforced (#17334) 2025-12-02 22:46:03 -08:00
vector_store_integrations [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
weave feat: Basic Weave OTEL integration (#17439) 2025-12-03 21:26:22 -08:00
__init__.py add linting 2023-08-18 11:05:05 -07:00
additional_logging_utils.py (Feat) - Allow viewing Request/Response Logs stored in GCS Bucket (#8449) 2025-02-10 20:38:55 -08:00
anthropic_cache_control_hook.py [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
argilla.py build(pyproject.toml): add new dev dependencies - for type checking (#9631) 2025-03-29 11:02:13 -07:00
athina.py build(pyproject.toml): add new dev dependencies - for type checking (#9631) 2025-03-29 11:02:13 -07:00
braintrust_logging.py Add details in docs (#15721) 2025-10-21 16:57:51 -07:00
callback_configs.json Working setting generic callbacks on UI 2025-12-05 14:37:48 -08:00
custom_batch_logger.py build(pyproject.toml): add new dev dependencies - for type checking (#9631) 2025-03-29 11:02:13 -07:00
custom_guardrail.py Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) 2025-12-15 18:19:52 +05:30
custom_logger.py Prompt Management - new API for integrating providers (#17829) 2025-12-11 15:43:40 -08:00
custom_prompt_management.py [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
custom_secret_manager.py [Feat] Add Custom Secret Manager - Allow users to define and write a custom secret manager (#16297) 2025-11-05 17:20:26 -08:00
custom_sso_handler.py [Feat] SSO - Allow users to run a custom sso login handler (#12465) 2025-07-09 16:36:30 -07:00
dynamodb.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
email_alerting.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
galileo.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
greenscale.py LITELLM: Remove requests library usage (#7235) 2024-12-17 12:50:04 -08:00
helicone.py (Bug) Fix JSON serialization error in Helicone logging by removing OpenTelemetry span from metadata (#15728) 2025-10-20 08:53:22 -07:00
humanloop.py [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing (#17920) 2025-12-13 08:18:43 -08:00
lago.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
langsmith.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
langtrace.py build(pyproject.toml): add new dev dependencies - for type checking (#9631) 2025-03-29 11:02:13 -07:00
literal_ai.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
logfire_logger.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
lunary.py build(pyproject.toml): add new dev dependencies - for type checking (#9631) 2025-03-29 11:02:13 -07:00
mlflow.py Fix: MLflow streaming spans for Anthropic passthrough (#17288) 2025-12-05 14:59:36 -08:00
openmeter.py [Bug]: Set user from token user_id for OpenMeter integration 2025-07-30 22:23:30 +02:00
opentelemetry.py [Fix] CI/CD - Fix failing proxy and core integration tests (#17926) 2025-12-13 10:11:01 -08:00
posthog.py fix: Add atexit handlers to flush callbacks for async completions (#16487) 2025-11-11 19:12:53 -08:00
prometheus.py refactor: litellm init file #1 2025-11-24 16:59:56 -08:00
prometheus_services.py add operational metrics for pod lock manager v2 arch 2025-04-04 16:41:07 -07:00
prompt_layer.py LITELLM: Remove requests library usage (#7235) 2024-12-17 12:50:04 -08:00
prompt_management_base.py Prompt Management - new API for integrating providers (#17829) 2025-12-11 15:43:40 -08:00
Readme.md (Feat) - Add GCS Pub/Sub Logging integration for sending DB SpendLogs to BigQuery (#7976) 2025-01-24 20:57:20 -08:00
s3.py Add allowing Key based prefix to s3 path (#16237) 2025-11-05 14:43:21 -08:00
s3_v2.py Add allowing Key based prefix to s3 path (#16237) 2025-11-05 14:43:21 -08:00
sqs.py Add Langfuse OTEL and SQS to health check (#16514) 2025-11-12 18:25:30 -08:00
supabase.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
test_httpx.py fix(utils.py): improved predibase exception mapping 2024-06-08 14:32:43 -07:00
traceloop.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
weights_biases.py [Security] Fix: Ensure .info() logs are not used for request/responses + Add code QA check for possible violations (#14386) 2025-09-09 13:55:56 -07:00

Readme.md

Integrations

This folder contains logging integrations for litellm

eg. logging to Datadog, Langfuse, Prometheus, s3, GCS Bucket, etc.