scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-07 08:26:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 89

test(test_token_counter.py): fix load test

Browse source
This commit is contained in:
Krrish Dholakia 2024-05-15 07:12:43 -07:00
parent 4ff0703a31
commit 900bb9aba8
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
litellm/tests/test_token_counter.py
View file

@ -178,7 +178,7 @@ def test_load_test_token_counter(model):
messages = [{"role": "user", "content": text}] * 10
start_time = time.time()
for _ in range(50):
for _ in range(10):
_ = token_counter(model=model, messages=messages)
# enc.encode("".join(m["content"] for m in messages))