scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-10 03:28:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 85

test(e2e): ask the streamed /v1/messages pin for a reply long enough to span several deltas

Browse source 
Anthropic now returns the 64-token 'count to 20' reply in one to three content_block_delta events, measured directly against api.anthropic.com and through proxies at 7672399 and 49a1145 alike, so the incrementality assertion (at least two deltas) failed in litellm-e2e builds 125, 130 and the 278 rerun with no proxy change behind it. A 'count to 100' reply at max_tokens 400 arrived in five to fifty deltas across every measured run
This commit is contained in:
Yuneng Jiang 2026-09-05 13:23:38 -07:00
parent 5df0e12e0f
commit d6bc8fe289
No known key found for this signature in database
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
tests/e2e/llm_translation/test_messages_e2e.py
View file

@ -169,9 +169,9 @@ class TestAnthropicMessages:
key,
AnthropicMessagesBody(
model=model,
max_tokens=64,
max_tokens=400,
stream=True,
messages=[ChatMessage(role="user", content="Count from 1 to 20, one number per line.")],
messages=[ChatMessage(role="user", content="Count from 1 to 100, one number per line.")],
),
)
require_successful_call(result)