diff --git a/docs/my-website/release_notes/v1.81.9.md b/docs/my-website/release_notes/v1.81.9.md index 14f3510ac0f..ac7519e297b 100644 --- a/docs/my-website/release_notes/v1.81.9.md +++ b/docs/my-website/release_notes/v1.81.9.md @@ -23,7 +23,7 @@ import Image from '@theme/IdealImage'; -```bash +``` showLineNumbers title="docker run litellm" docker run \ -e STORE_MODEL_IN_DB=True \ -p 4000:4000 \ @@ -33,7 +33,7 @@ docker.litellm.ai/berriai/litellm:main-v1.81.9 -```bash +``` showLineNumbers title="pip install litellm" pip install litellm==1.81.9 ``` @@ -44,15 +44,27 @@ pip install litellm==1.81.9 - **Claude Opus 4.6** - Full support across Anthropic, AWS Bedrock, Azure AI, and Vertex AI with adaptive thinking and 1M context window - **A2A Agent Gateway** - Call A2A (Agent-to-Agent) registered agents through the standard `/chat/completions` API -- **MCP Semantic Filtering** - Filter MCP tools using semantic similarity to reduce tool sprawl for LLM calls -- **MCP IP-Based Access Control** - Set MCP servers as public/private with IP-based restrictions for internet-facing deployments +- **Expose MCP servers on the public internet** - Launch MCP servers with public/private visibility and IP-based access control for internet-facing deployments - **Performance Optimizations** - Multiple performance improvements including ~40% Prometheus CPU reduction, LRU caching, and optimized logging paths +--- + +## MCP Servers on the Public Internet + +This release makes it safe to expose MCP servers on the public internet by adding public/private visibility and IP-based access control. You can now run internet-facing MCP services while restricting access to trusted networks and keeping internal tools private. + +[Get started](../../docs/mcp_public_internet) + +{/* TODO: Add screenshot - save as mcp_public_internet.png */} +{/* */} + Let's dive in. +--- + ## New Models / Updated Models -#### New Model Support +#### New Model Support (13 new models) | Provider | Model | Context Window | Input ($/1M tokens) | Output ($/1M tokens) | Features | | -------- | ----- | -------------- | ------------------- | -------------------- | -------- | @@ -104,6 +116,12 @@ Let's dive in. - **[OpenRouter](../../docs/providers/openrouter)** - Add Qwen3-235B models - [PR #20455](https://github.com/BerriAI/litellm/pull/20455) +- **[Together AI](../../docs/providers/togetherai)** + - Add GLM-4.7 and Kimi-K2.5 models - [PR #20319](https://github.com/BerriAI/litellm/pull/20319) + +- **[ElevenLabs](../../docs/providers/elevenlabs)** + - Add `eleven_v3` and `eleven_multilingual_v2` TTS models - [PR #20522](https://github.com/BerriAI/litellm/pull/20522) + - **[Vercel AI Gateway](../../docs/providers/vercel_ai_gateway)** - Add missing capability flags to models - [PR #20276](https://github.com/BerriAI/litellm/pull/20276) @@ -119,11 +137,6 @@ Let's dive in. - **[OpenAI](../../docs/providers/openai)** - Add `gpt-5-search-api` model and docs clarifications - [PR #20512](https://github.com/BerriAI/litellm/pull/20512) -#### New Provider Support - -- **[Together AI](../../docs/providers/togetherai)** - Added GLM-4.7 and Kimi-K2.5 models - [PR #20319](https://github.com/BerriAI/litellm/pull/20319) -- **[ElevenLabs](../../docs/providers/elevenlabs)** - Added `eleven_v3` and `eleven_multilingual_v2` TTS models - [PR #20522](https://github.com/BerriAI/litellm/pull/20522) - ### Bug Fixes - **[Anthropic](../../docs/providers/anthropic)** @@ -135,10 +148,17 @@ Let's dive in. - **[OpenAI Embeddings](../../docs/providers/openai)** - Fix `open_ai_embedding_models` to have `custom_llm_provider` None - [PR #20253](https://github.com/BerriAI/litellm/pull/20253) -## LLM API Endpoints +--- + +## LLM API Endpoints (2 new endpoints) #### Features +| Endpoint | Method | Description | Documentation | +| -------- | ------ | ----------- | ------------- | +| `/chat/completions` | POST | A2A agent invocation via standard completions API | [Docs](../../docs/a2a) | +| `/files` | GET/DELETE | Gemini file retrieval and deletion by `file_id` | [Docs](../../docs/providers/gemini) | + - **[A2A Agent Gateway](../../docs/a2a)** - Allow calling A2A agents through LiteLLM `/chat/completions` API - [PR #20358](https://github.com/BerriAI/litellm/pull/20358) - Use A2A registered agents with `/chat/completions` - [PR #20362](https://github.com/BerriAI/litellm/pull/20362) @@ -149,16 +169,10 @@ Let's dive in. - **General** - Add User-Agent customization support - [PR #19881](https://github.com/BerriAI/litellm/pull/19881) - - Add `proxy_auth` for auto OAuth2/JWT token management in SDK - [PR #20238](https://github.com/BerriAI/litellm/pull/20238) - Fix search tools not found when using per-request routers - [PR #19818](https://github.com/BerriAI/litellm/pull/19818) - Forward extra headers in chat - [PR #20386](https://github.com/BerriAI/litellm/pull/20386) -#### Bugs - -- **General** - - Revert httpx client caching that caused closed client errors - [PR #20025](https://github.com/BerriAI/litellm/pull/20025) - - Fix: only create Router when models or search_tools exist - [PR #20661](https://github.com/BerriAI/litellm/pull/20661) - - Fix 404 Not Found on `/api/event_logging/batch` endpoint - [PR #20504](https://github.com/BerriAI/litellm/pull/20504) +--- ## Management Endpoints / UI @@ -169,6 +183,9 @@ Let's dive in. - UI - SSO: Add Team Mappings - [PR #20299](https://github.com/BerriAI/litellm/pull/20299) - Extract user roles from JWT access token for Keycloak compatibility - [PR #20591](https://github.com/BerriAI/litellm/pull/20591) +- **Auth / SDK** + - Add `proxy_auth` for auto OAuth2/JWT token management in SDK - [PR #20238](https://github.com/BerriAI/litellm/pull/20238) + - **Virtual Keys** - Key `reset_spend` endpoint - [PR #20305](https://github.com/BerriAI/litellm/pull/20305) - UI - Keys: Allowed Routes to Key Info and Edit Pages - [PR #20369](https://github.com/BerriAI/litellm/pull/20369) @@ -203,12 +220,14 @@ Let's dive in. - UI - Model Page: Column Resizing on Smaller Screens - [PR #20599](https://github.com/BerriAI/litellm/pull/20599) - Fix `/key/list` `user_id` Empty String Edge Case - [PR #20623](https://github.com/BerriAI/litellm/pull/20623) - Add array type checks for model, agent, and MCP hub data to prevent UI crashes - [PR #20469](https://github.com/BerriAI/litellm/pull/20469) -- Non Root Dockerfile: Keep `package-lock.json` - [PR #20452](https://github.com/BerriAI/litellm/pull/20452) - Fix unique constraint on daily tables + logging when updates fail - [PR #20394](https://github.com/BerriAI/litellm/pull/20394) +- Fix 404 Not Found on `/api/event_logging/batch` endpoint - [PR #20504](https://github.com/BerriAI/litellm/pull/20504) + +--- ## Logging / Guardrail / Prompt Management Integrations -#### Bug Fixes +#### Bug Fixes (3 fixes) - **[Langfuse](../../docs/proxy/logging#langfuse)** - Fix Langfuse OTEL trace export failing when spans contain null attributes - [PR #20382](https://github.com/BerriAI/litellm/pull/20382) @@ -219,7 +238,7 @@ Let's dive in. - **[Slack Alerts](../../docs/proxy/alerting)** - Fix Slack alert delivery failing for certain budget threshold configurations - [PR #20257](https://github.com/BerriAI/litellm/pull/20257) -#### Guardrails +#### Guardrails (7 updates) - **Custom Code Guardrails** - Add HTTP support to custom code guardrails + Unified guardrails for MCP + Agent guardrail support - [PR #20619](https://github.com/BerriAI/litellm/pull/20619) @@ -238,11 +257,15 @@ Let's dive in. - Check for `model_response_choices` before guardrail input - [PR #19784](https://github.com/BerriAI/litellm/pull/19784) - Preserve streaming content on guardrail-sampled chunks - [PR #20027](https://github.com/BerriAI/litellm/pull/20027) +--- + ## Spend Tracking, Budgets and Rate Limiting - **Support 0 cost models** - Allow zero-cost model entries for internal/free-tier models - [PR #20249](https://github.com/BerriAI/litellm/pull/20249) -## MCP Gateway +--- + +## MCP Gateway (9 updates) - **MCP Semantic Filtering** - Filter MCP tools using semantic similarity to reduce tool sprawl for LLM calls - [PR #20296](https://github.com/BerriAI/litellm/pull/20296), [PR #20316](https://github.com/BerriAI/litellm/pull/20316) - **UI - MCP Semantic Filtering** - Add support for MCP Semantic Filtering configuration on UI - [PR #20454](https://github.com/BerriAI/litellm/pull/20454) @@ -254,9 +277,13 @@ Let's dive in. - **Ensure MCP permissions are enforced** when using JWT Auth - [PR #20383](https://github.com/BerriAI/litellm/pull/20383) - **Fix `gcs_bucket_name` not being passed** correctly for MCP server storage configuration - [PR #20491](https://github.com/BerriAI/litellm/pull/20491) -## Performance / Loadbalancing / Reliability improvements +--- + +## Performance / Loadbalancing / Reliability improvements (14 improvements) - **Prometheus ~40% CPU reduction** - Parallelize budget metrics, fix caching bug, reduce CPU usage - [PR #20544](https://github.com/BerriAI/litellm/pull/20544) +- **Prevent closed client errors** by reverting httpx client caching - [PR #20025](https://github.com/BerriAI/litellm/pull/20025) +- **Avoid unnecessary Router creation** when no models or search tools are configured - [PR #20661](https://github.com/BerriAI/litellm/pull/20661) - **Optimize `wrapper_async`** with `CallTypes` caching and reduced lookups - [PR #20204](https://github.com/BerriAI/litellm/pull/20204) - **Cache `_get_relevant_args_to_use_for_logging()`** at module level - [PR #20077](https://github.com/BerriAI/litellm/pull/20077) - **LRU cache for `normalize_request_route`** - [PR #19812](https://github.com/BerriAI/litellm/pull/19812) @@ -269,6 +296,8 @@ Let's dive in. - **Warn when budget lookup fails** to surface silent caching misses - [PR #20545](https://github.com/BerriAI/litellm/pull/20545) - **Add INFO-level session reuse logging** per request for better observability - [PR #20597](https://github.com/BerriAI/litellm/pull/20597) +--- + ## Database Changes ### Schema Updates @@ -281,7 +310,9 @@ Let's dive in. | `LiteLLM_DeletedTeamTable` | New Column | Added `soft_budget` (double precision) | [PR #20653](https://github.com/BerriAI/litellm/pull/20653) | [Migration](https://github.com/BerriAI/litellm/blob/main/litellm-proxy-extras/litellm_proxy_extras/migrations/20260207110613_add_soft_budget_to_deleted_teams_table/migration.sql) | | `LiteLLM_MCPServerTable` | New Column | Added `available_on_public_internet` boolean for MCP IP-based access control | [PR #20607](https://github.com/BerriAI/litellm/pull/20607) | [Migration](https://github.com/BerriAI/litellm/blob/main/litellm-proxy-extras/litellm_proxy_extras/migrations/20260207093506_add_available_on_public_internet_to_mcp_servers/migration.sql) | -## Documentation Updates +--- + +## Documentation Updates (15 updates) - Update v1.81.6 release notes - Logs v2 with Tool Call Tracing - [PR #20225](https://github.com/BerriAI/litellm/pull/20225) - Add FAQ for setting up and verifying LITELLM_LICENSE - [PR #20284](https://github.com/BerriAI/litellm/pull/20284) @@ -299,6 +330,8 @@ Let's dive in. - Update Opus 4.6 blog with adaptive thinking - [PR #20637](https://github.com/BerriAI/litellm/pull/20637) - `gpt-5-search-api` docs clarifications - [PR #20512](https://github.com/BerriAI/litellm/pull/20512) +--- + ## New Contributors * @Quentin-M made their first contribution in [PR #19818](https://github.com/BerriAI/litellm/pull/19818) * @amirzaushnizer made their first contribution in [PR #20235](https://github.com/BerriAI/litellm/pull/20235) @@ -309,5 +342,7 @@ Let's dive in. * @swayambhu94 made their first contribution in [PR #20469](https://github.com/BerriAI/litellm/pull/20469) * @ssadedin made their first contribution in [PR #20566](https://github.com/BerriAI/litellm/pull/20566) +--- + ## Full Changelog [v1.81.6-nightly...v1.81.9](https://github.com/BerriAI/litellm/compare/v1.81.6-nightly...v1.81.9)