From 0e8f60fe67e6742a01487d9105b18062e339fff0 Mon Sep 17 00:00:00 2001 From: Teddy Amkie Date: Thu, 25 Sep 2025 16:09:41 -0700 Subject: [PATCH] Remove aiohttp_ prefix from config (#14920) * Fix: Correct model name in load test advanced docs Co-authored-by: teddy * Fix: Update load testing provider to openai/fake Co-authored-by: teddy --------- Co-authored-by: Cursor Agent --- docs/my-website/docs/load_test_advanced.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/my-website/docs/load_test_advanced.md b/docs/my-website/docs/load_test_advanced.md index 0b3d38f3fcc..3171bc33594 100644 --- a/docs/my-website/docs/load_test_advanced.md +++ b/docs/my-website/docs/load_test_advanced.md @@ -27,13 +27,13 @@ Tutorial on how to get to 1K+ RPS with LiteLLM Proxy on locust **Use this config for testing:** -**Note:** we're currently migrating to aiohttp which has 10x higher throughput. We recommend using the `aiohttp_openai/` provider for load testing. +**Note:** we're currently migrating to aiohttp which has 10x higher throughput. We recommend using the `openai/` provider for load testing. ```yaml model_list: - model_name: "fake-openai-endpoint" litellm_params: - model: aiohttp_openai/any + model: openai/any api_base: https://your-fake-openai-endpoint.com/chat/completions api_key: "test" ``` @@ -58,7 +58,7 @@ litellm provides a hosted `fake-openai-endpoint` you can load test against model_list: - model_name: fake-openai-endpoint litellm_params: - model: aiohttp_openai/fake + model: openai/fake api_key: fake-key api_base: https://exampleopenaiendpoint-production.up.railway.app/