mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-05 02:41:56 +00:00
11 lines
No EOL
417 B
Markdown
11 lines
No EOL
417 B
Markdown
import Image from '@theme/IdealImage';
|
|
|
|
# LiteLLM Proxy Performance
|
|
|
|
### Throughput - 30% Increase
|
|
LiteLLM proxy + Load Balancer gives **30% increase** in throughput compared to Raw OpenAI API
|
|
<Image img={require('../../img/throughput.png')} />
|
|
|
|
### Latency Added - 0.00325 seconds
|
|
LiteLLM proxy adds **0.00325 seconds** latency as compared to using the Raw OpenAI API
|
|
<Image img={require('../../img/latency.png')} /> |