scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-13 23:11:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 101

docs: improve performance section explanation with technical details

Browse source 
Add details about O(1) dictionary lookup optimization and explain why this has high impact (runs in client decorator on every proxy request).
This commit is contained in:
Alexsander Hamir 2026-01-10 16:23:14 -08:00
parent 9e7c5cd809
commit 50ebbc7a7a
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docs/my-website/release_notes/v1.80.14/index.md
View file

@ -61,7 +61,7 @@ pip install litellm==1.80.14
## Performance - 50% Overhead Reduction
LiteLLM now sends 2.5× more requests to LLM providers by reducing wrapper function overhead across all endpoints.
LiteLLM now sends 2.5× more requests to LLM providers by replacing sequential if/elif chains with O(1) dictionary lookups for provider configuration resolution (92.7% faster). This optimization has a high impact because it runs inside the client decorator, which is invoked on every HTTP request to the proxy server.
### Before