mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-13 23:11:40 +00:00
docs: improve wording in performance section
This commit is contained in:
parent
50ebbc7a7a
commit
d998e98628
1 changed files with 1 additions and 1 deletions
|
|
@ -61,7 +61,7 @@ pip install litellm==1.80.14
|
|||
|
||||
## Performance - 50% Overhead Reduction
|
||||
|
||||
LiteLLM now sends 2.5× more requests to LLM providers by replacing sequential if/elif chains with O(1) dictionary lookups for provider configuration resolution (92.7% faster). This optimization has a high impact because it runs inside the client decorator, which is invoked on every HTTP request to the proxy server.
|
||||
LiteLLM now sends 2.5× more requests to LLM providers by replacing sequential if/elif chains with O(1) dictionary lookups for provider configuration resolution (92.7% faster). This optimization has a high impact because it runs inside the client decorator, which is invoked on every HTTP request made to the proxy server.
|
||||
|
||||
### Before
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue