scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-11 03:38:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 82
litellm/gatewaybench/tests/throughput
History
Exact
Devin AI 343979cd31 feat(gatewaybench): scaffold AI-gateway overhead benchmark 
Co-Authored-By: Ishaan Jaffer <155045088+ishaan-berri@users.noreply.github.com>
2026-07-18 23:04:07 +00:00
..
src feat(gatewaybench): scaffold AI-gateway overhead benchmark 2026-07-18 23:04:07 +00:00
Cargo.toml feat(gatewaybench): scaffold AI-gateway overhead benchmark 2026-07-18 23:04:07 +00:00
README.md feat(gatewaybench): scaffold AI-gateway overhead benchmark 2026-07-18 23:04:07 +00:00

README.md

This test measures the maximum sustained RPS before the latency knee. It also measures CPU and RSS cost per one million requests.