diff --git a/docs/my-website/img/release_notes/perf_imp.png b/docs/my-website/img/release_notes/perf_imp.png new file mode 100644 index 00000000000..9fef6a6b2d7 Binary files /dev/null and b/docs/my-website/img/release_notes/perf_imp.png differ diff --git a/docs/my-website/img/release_notes/quota.png b/docs/my-website/img/release_notes/quota.png new file mode 100644 index 00000000000..f8d15747f81 Binary files /dev/null and b/docs/my-website/img/release_notes/quota.png differ diff --git a/docs/my-website/release_notes/v1.77.3-stable/index.md b/docs/my-website/release_notes/v1.77.3-stable/index.md index 5eaeb4c531a..c7c17e5baee 100644 --- a/docs/my-website/release_notes/v1.77.3-stable/index.md +++ b/docs/my-website/release_notes/v1.77.3-stable/index.md @@ -51,14 +51,23 @@ pip install litellm==1.77.3 ## Priority Quota Reservation +This release adds support for priority quota reservation. This allows Proxy Admins to reserve specific percentages of model capacity for different use cases. + +This is great for use cases where you want to ensure your realtime use cases must always get priority responses and background development jobs can take longer. + + + +
+ This release adds support for priority quota reservation. This allows **Proxy Admins** to reserve TPM/RPM capacity for keys based on metadata priority levels, ensuring critical production workloads get guaranteed access regardless of development traffic volume. Get started [here](../../docs/proxy/dynamic_rate_limit#priority-quota-reservation) - - ## +550 RPS Performance Improvements + + +
This release delivers significant RPS improvements through targeted optimizations.