mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-29 06:33:28 +00:00
docs: complete Bedrock count-token e2e docstring
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
This commit is contained in:
parent
6b616c9fd3
commit
8f4aeb2d6f
1 changed files with 1 additions and 1 deletions
|
|
@ -6,7 +6,7 @@ CountTokens answers 400 for it. The proxy then has to count through bedrock-mant
|
|||
Anthropic count_tokens, and the answer must sit within a few percent of what `/v1/messages`
|
||||
bills as `usage.input_tokens`. The local tokenizer fallback undercounts these models by
|
||||
about 40%, so this is the line that proves the real count is served. Both calls go through
|
||||
the real Anthropic SDK, the client customers count with
|
||||
the real Anthropic SDK, as a customer would use them.
|
||||
"""
|
||||
|
||||
from __future__ import annotations
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue