diff --git a/docs/my-website/docs/proxy/deploy.md b/docs/my-website/docs/proxy/deploy.md index 745d7996649..051f0af5959 100644 --- a/docs/my-website/docs/proxy/deploy.md +++ b/docs/my-website/docs/proxy/deploy.md @@ -76,6 +76,8 @@ Your LiteLLM container should be running now on the defined port e.g. `8000`. ## LiteLLM Proxy Performance +LiteLLM proxy has been load tested to handle 1500 req/s. + ### Throughput - 30% Increase LiteLLM proxy + Load Balancer gives **30% increase** in throughput compared to Raw OpenAI API