- Remove Explore section from Learn page - Common Tasks: Stream Responses → core_request_response_patterns, Use Tools → tools_integrations, Add Routing → routing-load-balancing - Rename Router & Fallbacks card to Routing & Load Balancing on docs index - Fix Agent & MCP Gateway cards, add letta to Agent SDKs sidebar - Gateway quickstart: Make LLM Requests card first, rename from Connect SDKs - Integrations: fix View all links (observability_integrations, guardrail_providers) - SDK quickstart: remove Use Gateway card, keep When To Use Gateway section Made-with: Cursor
7 KiB
| title | sidebar_label |
|---|---|
| Integrations | Overview |
import NavigationCards from '@site/src/components/NavigationCards';
This section covers integrations with various tools and services that can be used with LiteLLM (either Proxy or SDK).
Observability
Track, debug, and analyze LLM calls with observability platforms.
<NavigationCards columns={3} items={[ { icon: "🪢", title: "Langfuse", description: "LLM observability and analytics.", to: "/docs/observability/langfuse_integration", }, { icon: "🐶", title: "Datadog", description: "Metrics, traces, and dashboards.", to: "/docs/observability/datadog", }, { icon: "📡", title: "OpenTelemetry", description: "Vendor-neutral tracing.", to: "/docs/observability/opentelemetry_integration", }, { icon: "🔗", title: "LangSmith", description: "LLM debugging and evaluation.", to: "/docs/observability/langsmith_integration", }, { icon: "🔥", title: "Arize / Phoenix", description: "ML observability and evaluation.", to: "/docs/observability/arize_integration", }, { icon: "🌀", title: "Helicone", description: "LLM request logging and analytics.", to: "/docs/observability/helicone_integration", }, { icon: "📊", title: "MLflow", description: "Experiment tracking.", to: "/docs/observability/mlflow", }, { icon: "🏋️", title: "Weights & Biases", description: "ML experiment tracking.", to: "/docs/observability/wandb_integration", }, { icon: "📉", title: "PostHog", description: "Product analytics.", to: "/docs/observability/posthog_integration", }, ]} />
View all observability integrations →
Alerting & Monitoring
Set up alerts, metrics collection, and infrastructure monitoring.
<NavigationCards columns={2} items={[ { icon: "📈", title: "Prometheus", description: "Metrics collection and monitoring.", to: "../proxy/prometheus", }, { icon: "🚨", title: "PagerDuty", description: "Incident response and alerting.", to: "../proxy/pagerduty", }, { icon: "🔔", title: "Alerting", description: "Slack, Teams, and webhook alerts.", to: "../proxy/alerting", }, { icon: "🔍", title: "Pyroscope", description: "Continuous profiling.", to: "../proxy/pyroscope_profiling", }, ]} />
Guardrail Providers
Add safety and content filtering to LLM calls.
<NavigationCards columns={3} items={[ { icon: "🛡️", title: "Lakera AI", description: "Prompt injection detection.", to: "/docs/proxy/guardrails/lakera_ai", }, { icon: "☁️", title: "Azure Content Safety", description: "Content moderation.", to: "/docs/proxy/guardrails/azure_content_guardrail", }, { icon: "🛏️", title: "Bedrock Guardrails", description: "AWS Bedrock safety.", to: "/docs/proxy/guardrails/bedrock", }, { icon: "🤖", title: "OpenAI Moderation", description: "OpenAI content policy.", to: "/docs/proxy/guardrails/openai_moderation", }, { icon: "🔐", title: "Secret Detection", description: "Prevent credential leaks.", to: "/docs/proxy/guardrails/secret_detection", }, { icon: "🕵️", title: "PII Masking", description: "Mask sensitive data.", to: "/docs/proxy/guardrails/pii_masking_v2", }, ]} />
View all guardrail providers →
Policies
Define and enforce usage policies across your LLM deployment.
<NavigationCards columns={3} items={[ { icon: "📋", title: "Guardrail Policies", description: "Policy-based guardrail rules.", to: "../proxy/guardrails/guardrail_policies", }, { icon: "🔀", title: "Policy Flow Builder", description: "Visual policy configuration.", to: "../proxy/guardrails/policy_flow_builder", }, { icon: "📄", title: "Policy Templates", description: "Pre-built policy templates.", to: "../proxy/guardrails/policy_templates", }, ]} />
AI Tools
Connect LiteLLM to AI-powered coding and productivity tools.
<NavigationCards columns={3} items={[ { icon: "💬", title: "OpenWebUI", description: "Self-hosted ChatGPT-style interface.", to: "../tutorials/openweb_ui", }, { icon: "🤖", title: "Claude Code", description: "Use LiteLLM with Claude Code.", to: "../tutorials/claude_responses_api", }, { icon: "🖱️", title: "Cursor", description: "AI code editor integration.", to: "../tutorials/cursor_integration", }, { icon: "🐙", title: "GitHub Copilot", description: "GitHub Copilot integration.", to: "../tutorials/github_copilot_integration", }, { icon: "💻", title: "OpenCode", description: "Open source coding assistant.", to: "../tutorials/opencode_integration", }, { icon: "🔧", title: "Retool Assist", description: "Retool AI assistant.", to: "../tutorials/retool_assist", }, ]} />
Agent SDKs
Use LiteLLM with agent frameworks and SDKs.
<NavigationCards columns={3} items={[ { icon: "🤖", title: "OpenAI Agents SDK", description: "Build agents with OpenAI's SDK.", to: "../tutorials/openai_agents_sdk", }, { icon: "🧠", title: "Claude Agent SDK", description: "Build agents with Anthropic's SDK.", to: "../tutorials/claude_agent_sdk", }, { icon: "🌐", title: "Google ADK", description: "Google Agent Development Kit.", to: "../tutorials/google_adk", }, { icon: "🚀", title: "CopilotKit", description: "In-app AI copilots.", to: "../tutorials/copilotkit_sdk", }, { icon: "🧬", title: "Letta", description: "Build stateful LLM agents with persistent memory.", to: "./letta", }, { icon: "🎙️", title: "LiveKit", description: "Real-time voice and video AI agents.", to: "../tutorials/livekit_xai_realtime", }, ]} />
Prompt Management
Manage, version, and deploy prompts.
<NavigationCards columns={3} items={[ { icon: "📝", title: "LiteLLM Prompt Management", description: "Built-in prompt management.", to: "../proxy/litellm_prompt_management", }, { icon: "🔌", title: "Custom Prompt Management", description: "Bring your own prompt store.", to: "../proxy/custom_prompt_management", }, { icon: "🔥", title: "Arize Phoenix Prompts", description: "Prompt management with Phoenix.", to: "../proxy/arize_phoenix_prompts", }, ]} />
Manage with AI Agents
Use AI agents to manage your LiteLLM deployment — create users, teams, keys, models, and more via natural language.
<NavigationCards columns={1} items={[ { icon: "🤖", title: "LiteLLM Skills", description: "Manage LiteLLM via Claude Code — create keys, teams, models, and more using natural language commands.", to: "../tutorials/claude_code_skills", }, ]} />