(docs) set user tpm/rpm limits

This commit is contained in:
ishaan-jaff 2024-02-22 19:23:16 -08:00
parent a13243652f
commit 2122a7cf1e

View file

@ -279,9 +279,9 @@ curl 'http://0.0.0.0:8000/key/generate' \
## Set Rate Limits
You can set:
- tpm limits (tokens per minute)
- rpm limits (requests per minute)
- max parallel requests
- tpm limits
- rpm limits
<Tabs>
<TabItem value="per-user" label="Per User">