diff --git a/docs/my-website/release_notes/v1.77.7-stable/index.md b/docs/my-website/release_notes/v1.77.7-stable/index.md index 2631a7bbfb6..f6b088dda8a 100644 --- a/docs/my-website/release_notes/v1.77.7-stable/index.md +++ b/docs/my-website/release_notes/v1.77.7-stable/index.md @@ -65,12 +65,10 @@ pip install litellm==1.77.7.rc.1 - **AMD Lemonade & Nvidia NIM** - New provider support for AMD Lemonade and Nvidia NIM Rerank - **GitLab Prompt Management** - GitLab-based prompt management integration -### 2.9x Lower Median Latency +### Performance - 2.9x Lower Median Latency -
- This update removes LiteLLM router inefficiencies, reducing complexity from O(M×N) to O(1). Previously, it built a new array and ran repeated checks like data["model"] in llm_router.get_model_ids(). Now, a direct ID-to-deployment map eliminates redundant allocations and scans. As a result, performance improved across all latency percentiles: