diff --git a/docs/my-website/img/release_notes/v1_messages_perf.png b/docs/my-website/img/release_notes/v1_messages_perf.png new file mode 100644 index 00000000000..3d5744e1be1 Binary files /dev/null and b/docs/my-website/img/release_notes/v1_messages_perf.png differ diff --git a/docs/my-website/release_notes/v1.72.2/index.md b/docs/my-website/release_notes/v1.72.2/index.md index 2da5e62c27f..eb490017812 100644 --- a/docs/my-website/release_notes/v1.72.2/index.md +++ b/docs/my-website/release_notes/v1.72.2/index.md @@ -66,6 +66,16 @@ pip install litellm==1.72.2 --- +## `/v1/messages` Performance Improvements + +This release brings significant performance improvements to the `/v1/messages` API. For large streaming requests LiteLLM overhead latency is now 50ms and can handle 250 RPS per instance. + + + + ## New Models / Updated Models **Newly Added Models**