mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-07 08:26:10 +00:00
docs latency headers
This commit is contained in:
parent
bb86619605
commit
f8f9e2299b
1 changed files with 1 additions and 1 deletions
|
|
@ -32,7 +32,7 @@ These headers are useful for clients to understand the current rate limit status
|
|||
## Latency Headers
|
||||
| Header | Type | Description |
|
||||
|--------|------|-------------|
|
||||
| `x-litellm-response-duration-ms` | float | Total duration of the API response in milliseconds |
|
||||
| `x-litellm-response-duration-ms` | float | Total duration from the moment that a request gets to LiteLLM Proxy to the moment it gets returned to the client. |
|
||||
| `x-litellm-overhead-duration-ms` | float | LiteLLM processing overhead in milliseconds |
|
||||
|
||||
## Retry, Fallback Headers
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue