scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-07 08:26:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 36

performance write up (#18296)

Browse source
This commit is contained in:
Alexsander Hamir 2025-12-20 12:30:17 -08:00 • committed by GitHub
parent acadaca7e7
commit 52fc18ec9a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 10 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
docs/my-website/release_notes/v1.80.11-stable/index.md
View file

@ -56,6 +56,16 @@ pip install litellm==1.80.11
---
### Performance: 50% Reduction in Memory Usage and Import Latency for the LiteLLM SDK
We've completely restructured `litellm.__init__.py` to defer heavy imports until they're actually needed, implementing lazy loading for **109 components**.
This refactoring includes **41 provider config classes**, **40 utility functions**, cache implementations (Redis, DualCache, InMemoryCache), HTTP handlers, logging, types, and other heavy dependencies. Heavy libraries like tiktoken and boto3 are now loaded on-demand rather than eagerly at import time.
This makes LiteLLM especially beneficial for serverless functions, Lambda deployments, and containerized environments where cold start times and memory footprint matter.
---
## New Providers and Endpoints
### New Providers (4 new providers)