From d548836903559ca77ffca0a0b66b9ac6de98f079 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Fri, 8 Dec 2023 07:33:33 -0800 Subject: [PATCH] docs: add proxy req/s --- docs/my-website/docs/proxy/deploy.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/my-website/docs/proxy/deploy.md b/docs/my-website/docs/proxy/deploy.md index 745d7996649..051f0af5959 100644 --- a/docs/my-website/docs/proxy/deploy.md +++ b/docs/my-website/docs/proxy/deploy.md @@ -76,6 +76,8 @@ Your LiteLLM container should be running now on the defined port e.g. `8000`. ## LiteLLM Proxy Performance +LiteLLM proxy has been load tested to handle 1500 req/s. + ### Throughput - 30% Increase LiteLLM proxy + Load Balancer gives **30% increase** in throughput compared to Raw OpenAI API