diff --git a/docs/my-website/release_notes/v1.65.0-stable/index.md b/docs/my-website/release_notes/v1.65.0-stable/index.md index 97aea832d2c..0a1610f7888 100644 --- a/docs/my-website/release_notes/v1.65.0-stable/index.md +++ b/docs/my-website/release_notes/v1.65.0-stable/index.md @@ -17,7 +17,17 @@ hide_table_of_contents: false LiteLLM v1.65.0 introduces significant enhancements including Model Context Protocol (MCP) tools, new models, and various performance improvements. -## New Models / Updated Models +## Model Context Protocol (MCP) + +This release introduces support for centrally adding MCP servers on LiteLLM. This allows you to add MCP endpoints and your developers can `list` and `call` MCP tools through LiteLLM. + +## Custom Prompt Management + +This release allows you to connect LiteLLM to any prompt management service through our custom prompt management hooks. As proxy admin all you need to do is implement a `get_chat_completion_prompt` hook which accepts a prompt_id and prompt_variables and returns a formatted prompt. + + +## Categorized Improvements and Fixes +### New Models / Updated Models - Support for Vertex AI gemini-2.0-flash-lite & Google AI Studio gemini-2.0-flash-lite [PR](https://github.com/BerriAI/litellm/pull/9523) - Support for Vertex AI Fine-Tuned LLMs [PR](https://github.com/BerriAI/litellm/pull/9542) - Nova Canvas image generation support [PR](https://github.com/BerriAI/litellm/pull/9525) @@ -25,53 +35,51 @@ LiteLLM v1.65.0 introduces significant enhancements including Model Context Prot - Added new Vertex AI text embedding model [PR](https://github.com/BerriAI/litellm/pull/9476) - Updated model prices and context windows [PR](https://github.com/BerriAI/litellm/pull/9459) -## LLM Translation +### LLM Translation - OpenAI Web Search Tool Call Support [PR](https://github.com/BerriAI/litellm/pull/9465) - Vertex AI topLogprobs support [PR](https://github.com/BerriAI/litellm/pull/9518) - Fixed Vertex AI multimodal embedding translation [PR](https://github.com/BerriAI/litellm/pull/9471) - Support litellm.api_base for Vertex AI + Gemini across completion, embedding, image_generation [PR](https://github.com/BerriAI/litellm/pull/9516) - Fixed Mistral chat transformation [PR](https://github.com/BerriAI/litellm/pull/9606) -## Spend Tracking Improvements +### Spend Tracking Improvements - Log 'api_base' on spend logs [PR](https://github.com/BerriAI/litellm/pull/9509) - Support for Gemini audio token cost tracking [PR](https://github.com/BerriAI/litellm/pull/9535) - Fixed OpenAI audio input token cost tracking [PR](https://github.com/BerriAI/litellm/pull/9535) - Added Daily User Spend Aggregate view - allows UI Usage tab to work > 1m rows [PR](https://github.com/BerriAI/litellm/pull/9538) - Connected UI to "LiteLLM_DailyUserSpend" spend table [PR](https://github.com/BerriAI/litellm/pull/9603) -## UI +### UI - Allowed team admins to add/update/delete models on UI [PR](https://github.com/BerriAI/litellm/pull/9572) - Show API base and model ID on request logs [PR](https://github.com/BerriAI/litellm/pull/9572) - Allow viewing keyinfo on request logs [PR](https://github.com/BerriAI/litellm/pull/9568) - Enabled viewing all wildcard models on /model/info [PR](https://github.com/BerriAI/litellm/pull/9473) - Added render supports_web_search on model hub [PR](https://github.com/BerriAI/litellm/pull/9469) -## Logging Integrations +### Logging Integrations - Fixed StandardLoggingPayload for GCS Pub Sub Logging Integration [PR](https://github.com/BerriAI/litellm/pull/9508) -## Performance / Reliability Improvements +### Performance / Reliability Improvements - LiteLLM Redis semantic caching implementation [PR](https://github.com/BerriAI/litellm/pull/9356) - Gracefully handle exceptions when DB is having an outage [PR](https://github.com/BerriAI/litellm/pull/9533) - Allow Pods to startup + passing /health/readiness when allow_requests_on_db_unavailable: True and DB is down [PR](https://github.com/BerriAI/litellm/pull/9569) - Removed hard coded final usage chunk on Bedrock streaming usage [PR](https://github.com/BerriAI/litellm/pull/9512) - Refactored Vertex AI passthrough routes - fixes unpredictable behaviour with auto-setting default_vertex_region on router model add [PR](https://github.com/BerriAI/litellm/pull/9467) -## General Improvements +### General Improvements - Support for exposing MCP tools on litellm proxy [PR](https://github.com/BerriAI/litellm/pull/9426) - Support discovering Gemini, Anthropic, xAI models by calling their /v1/model endpoint [PR](https://github.com/BerriAI/litellm/pull/9530) - Fixed route check for non-proxy admins on JWT auth [PR](https://github.com/BerriAI/litellm/pull/9454) - Added baseline Prisma database migrations [PR](https://github.com/BerriAI/litellm/pull/9565) - Get master key from environment, if not set [PR](https://github.com/BerriAI/litellm/pull/9617) -## Documentation +### Documentation - Fixed Predibase typo [PR](https://github.com/BerriAI/litellm/pull/9464) - Updated README.md [PR](https://github.com/BerriAI/litellm/pull/9616) -## Security +### Security - Bumped next from 14.2.21 to 14.2.25 in UI dashboard [PR](https://github.com/BerriAI/litellm/pull/9458) - - ## Complete Git Diff [Here's the complete git diff](https://github.com/BerriAI/litellm/compare/v1.63.14-stable.patch1...v1.65.0-stable)