From eb2770fee26114b304fd8bb30b287aa95ce7b9aa Mon Sep 17 00:00:00 2001
From: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Date: Tue, 14 Jan 2025 10:45:28 -0800
Subject: [PATCH] update benchmarks

---
 docs/my-website/docs/benchmarks.md | 8 +++++---
 1 file changed, 5 insertions(+), 3 deletions(-)

diff --git a/docs/my-website/docs/benchmarks.md b/docs/my-website/docs/benchmarks.md
index 570d45f8993..7939f835d18 100644
--- a/docs/my-website/docs/benchmarks.md
+++ b/docs/my-website/docs/benchmarks.md
@@ -20,11 +20,13 @@ model_list:
 
 ## 1 Instance LiteLLM Proxy
 
+In these tests the median latency of directly calling the fake-openai-endpoint is 60ms.
 
 | Metric | Litellm Proxy (1 Instance) |
 |--------|------------------------|
-| Median Latency (ms) | 110 |
-| RPS | 250 |
+| RPS | 500 |
+| Median Latency (ms) | 100 |
+| Latency overhead added by LiteLLM Proxy | 40ms |
 
 <!-- <Image img={require('../img/1_instance_proxy.png')} /> -->
 
@@ -33,7 +35,7 @@ model_list:
 <Image img={require('../img/instances_vs_rps.png')} /> -->
 
 #### Key Findings
-- Single instance: 250 RPS @ 100ms latency
+- Single instance: 500 RPS @ 100ms latency
 - 4 LiteLLM instances: 1000 RPS @ 100ms latency
 
 ### 2 Instances