litellm/docs/my-website/docs/integrations/index.md
Mr. Ånand 143cd66fa0 docs: Learn page updates, card links, integrations, sidebar changes
- Remove Explore section from Learn page
- Common Tasks: Stream Responses → core_request_response_patterns, Use Tools → tools_integrations, Add Routing → routing-load-balancing
- Rename Router & Fallbacks card to Routing & Load Balancing on docs index
- Fix Agent & MCP Gateway cards, add letta to Agent SDKs sidebar
- Gateway quickstart: Make LLM Requests card first, rename from Connect SDKs
- Integrations: fix View all links (observability_integrations, guardrail_providers)
- SDK quickstart: remove Use Gateway card, keep When To Use Gateway section

Made-with: Cursor
2026-03-18 17:19:27 +05:30

7 KiB

title sidebar_label
Integrations Overview

import NavigationCards from '@site/src/components/NavigationCards';

This section covers integrations with various tools and services that can be used with LiteLLM (either Proxy or SDK).


Observability

Track, debug, and analyze LLM calls with observability platforms.

<NavigationCards columns={3} items={[ { icon: "🪢", title: "Langfuse", description: "LLM observability and analytics.", to: "/docs/observability/langfuse_integration", }, { icon: "🐶", title: "Datadog", description: "Metrics, traces, and dashboards.", to: "/docs/observability/datadog", }, { icon: "📡", title: "OpenTelemetry", description: "Vendor-neutral tracing.", to: "/docs/observability/opentelemetry_integration", }, { icon: "🔗", title: "LangSmith", description: "LLM debugging and evaluation.", to: "/docs/observability/langsmith_integration", }, { icon: "🔥", title: "Arize / Phoenix", description: "ML observability and evaluation.", to: "/docs/observability/arize_integration", }, { icon: "🌀", title: "Helicone", description: "LLM request logging and analytics.", to: "/docs/observability/helicone_integration", }, { icon: "📊", title: "MLflow", description: "Experiment tracking.", to: "/docs/observability/mlflow", }, { icon: "🏋️", title: "Weights & Biases", description: "ML experiment tracking.", to: "/docs/observability/wandb_integration", }, { icon: "📉", title: "PostHog", description: "Product analytics.", to: "/docs/observability/posthog_integration", }, ]} />

View all observability integrations →


Alerting & Monitoring

Set up alerts, metrics collection, and infrastructure monitoring.

<NavigationCards columns={2} items={[ { icon: "📈", title: "Prometheus", description: "Metrics collection and monitoring.", to: "../proxy/prometheus", }, { icon: "🚨", title: "PagerDuty", description: "Incident response and alerting.", to: "../proxy/pagerduty", }, { icon: "🔔", title: "Alerting", description: "Slack, Teams, and webhook alerts.", to: "../proxy/alerting", }, { icon: "🔍", title: "Pyroscope", description: "Continuous profiling.", to: "../proxy/pyroscope_profiling", }, ]} />


Guardrail Providers

Add safety and content filtering to LLM calls.

<NavigationCards columns={3} items={[ { icon: "🛡️", title: "Lakera AI", description: "Prompt injection detection.", to: "/docs/proxy/guardrails/lakera_ai", }, { icon: "☁️", title: "Azure Content Safety", description: "Content moderation.", to: "/docs/proxy/guardrails/azure_content_guardrail", }, { icon: "🛏️", title: "Bedrock Guardrails", description: "AWS Bedrock safety.", to: "/docs/proxy/guardrails/bedrock", }, { icon: "🤖", title: "OpenAI Moderation", description: "OpenAI content policy.", to: "/docs/proxy/guardrails/openai_moderation", }, { icon: "🔐", title: "Secret Detection", description: "Prevent credential leaks.", to: "/docs/proxy/guardrails/secret_detection", }, { icon: "🕵️", title: "PII Masking", description: "Mask sensitive data.", to: "/docs/proxy/guardrails/pii_masking_v2", }, ]} />

View all guardrail providers →


Policies

Define and enforce usage policies across your LLM deployment.

<NavigationCards columns={3} items={[ { icon: "📋", title: "Guardrail Policies", description: "Policy-based guardrail rules.", to: "../proxy/guardrails/guardrail_policies", }, { icon: "🔀", title: "Policy Flow Builder", description: "Visual policy configuration.", to: "../proxy/guardrails/policy_flow_builder", }, { icon: "📄", title: "Policy Templates", description: "Pre-built policy templates.", to: "../proxy/guardrails/policy_templates", }, ]} />


AI Tools

Connect LiteLLM to AI-powered coding and productivity tools.

<NavigationCards columns={3} items={[ { icon: "💬", title: "OpenWebUI", description: "Self-hosted ChatGPT-style interface.", to: "../tutorials/openweb_ui", }, { icon: "🤖", title: "Claude Code", description: "Use LiteLLM with Claude Code.", to: "../tutorials/claude_responses_api", }, { icon: "🖱️", title: "Cursor", description: "AI code editor integration.", to: "../tutorials/cursor_integration", }, { icon: "🐙", title: "GitHub Copilot", description: "GitHub Copilot integration.", to: "../tutorials/github_copilot_integration", }, { icon: "💻", title: "OpenCode", description: "Open source coding assistant.", to: "../tutorials/opencode_integration", }, { icon: "🔧", title: "Retool Assist", description: "Retool AI assistant.", to: "../tutorials/retool_assist", }, ]} />


Agent SDKs

Use LiteLLM with agent frameworks and SDKs.

<NavigationCards columns={3} items={[ { icon: "🤖", title: "OpenAI Agents SDK", description: "Build agents with OpenAI's SDK.", to: "../tutorials/openai_agents_sdk", }, { icon: "🧠", title: "Claude Agent SDK", description: "Build agents with Anthropic's SDK.", to: "../tutorials/claude_agent_sdk", }, { icon: "🌐", title: "Google ADK", description: "Google Agent Development Kit.", to: "../tutorials/google_adk", }, { icon: "🚀", title: "CopilotKit", description: "In-app AI copilots.", to: "../tutorials/copilotkit_sdk", }, { icon: "🧬", title: "Letta", description: "Build stateful LLM agents with persistent memory.", to: "./letta", }, { icon: "🎙️", title: "LiveKit", description: "Real-time voice and video AI agents.", to: "../tutorials/livekit_xai_realtime", }, ]} />


Prompt Management

Manage, version, and deploy prompts.

<NavigationCards columns={3} items={[ { icon: "📝", title: "LiteLLM Prompt Management", description: "Built-in prompt management.", to: "../proxy/litellm_prompt_management", }, { icon: "🔌", title: "Custom Prompt Management", description: "Bring your own prompt store.", to: "../proxy/custom_prompt_management", }, { icon: "🔥", title: "Arize Phoenix Prompts", description: "Prompt management with Phoenix.", to: "../proxy/arize_phoenix_prompts", }, ]} />


Manage with AI Agents

Use AI agents to manage your LiteLLM deployment — create users, teams, keys, models, and more via natural language.

<NavigationCards columns={1} items={[ { icon: "🤖", title: "LiteLLM Skills", description: "Manage LiteLLM via Claude Code — create keys, teams, models, and more using natural language commands.", to: "../tutorials/claude_code_skills", }, ]} />