scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-08 03:08:45 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 115

docs fix

Browse source
This commit is contained in:
Ishaan Jaff 2025-09-06 16:07:02 -07:00
parent 0754ad9e02
commit 71ce338b24
1 changed files with 15 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

15
docs/my-website/release_notes/v1.76.3-stable/index.md
View file

@ -51,6 +51,21 @@ pip install litellm==1.76.3
## Major Changes
- **Performance Optimization**: LiteLLM Proxy now achieves +400 RPS when using correct amount of CPU cores - [PR #14153](https://github.com/BerriAI/litellm/pull/14153), [PR #14242](https://github.com/BerriAI/litellm/pull/14242)
By default, LiteLLM will now use `num_workers = os.cpu_count()` to achieve optimal performance.
**Override Options:**
Set environment variable:
```bash
DEFAULT_NUM_WORKERS_LITELLM_PROXY=1
```
Or start LiteLLM Proxy with:
```bash
litellm --num_workers 1
```
- **Security Fix**: Fixed memory_usage_in_mem_cache cache endpoint vulnerability - [PR #14229](https://github.com/BerriAI/litellm/pull/14229)
---