From 93022361e651b8ccd906523baa420642bfd5ba7e Mon Sep 17 00:00:00 2001 From: Ishaan Jaffer Date: Sat, 4 Oct 2025 18:03:04 -0700 Subject: [PATCH] docs fix --- docs/my-website/release_notes/v1.77.5-stable/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/my-website/release_notes/v1.77.5-stable/index.md b/docs/my-website/release_notes/v1.77.5-stable/index.md index a71cab45996..a321060d306 100644 --- a/docs/my-website/release_notes/v1.77.5-stable/index.md +++ b/docs/my-website/release_notes/v1.77.5-stable/index.md @@ -61,7 +61,7 @@ pip install litellm==1.77.5 Throughput increased by 54% (1,040 → 1,602 RPS, aggregated) per instance while maintaining a 40 ms median overhead. The improvement comes from fixing major O(n²) inefficiencies in the router, primarily caused by repeated use of in statements inside loops over large arrays. Tests were run with a database-only setup (no cache hits). As a result, p95 latency improved by 30% (2,700 → 1,900 ms), enhancing overall stability and scalability under heavy load. -### Test Setup +#### Test Setup All benchmarks were executed using Locust with 1,000 concurrent users and a ramp-up of 500. The environment was configured to stress the routing layer and eliminate caching as a variable.