scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-07 02:59:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 103

test(e2e): skip the batch rate-limiter spend-row test pending LIT-5027 (#35301)

Browse source 
The batch rate limiter counts input tokens by awaiting litellm.afile_content
with no timeout, so a slow Files API holds POST /v1/batches open past any
client deadline; stage saw 63.6s against the harness's 60s read timeout. The
test times out before reaching the unattributed-spend-row assertion it exists
to guard, so it reports an infrastructure hang rather than the contract.

Skipping keeps the signal honest until the fetch is bounded.
This commit is contained in:
ryan-crabbe-berri 2026-07-30 18:20:04 -07:00 • committed by GitHub
parent f0d13624be
commit 8ccbc3e735
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 10 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
tests/e2e/batches/test_batches_e2e.py
View file

@ -397,6 +397,16 @@ def unattributed_rows(rows: list[SpendLogRow]) -> list[SpendLogRow]:
return [row for row in rows if not row.api_key]
@pytest.mark.skip(
reason=(
"LIT-5027: the path under test hangs. The batch rate limiter reads the input file "
"to count tokens by awaiting litellm.afile_content with no timeout, so a slow Files "
"API holds POST /v1/batches open past any client deadline (63.6s observed on stage "
"against a 60s read timeout). The unattributed-spend-row contract below is never "
"reached, so the test reports a timeout rather than the behavior it guards. Unskip "
"once the fetch is bounded."
)
)
def test_rate_limited_batch_create_leaves_no_unattributed_spend_row(
client: BatchClient, resources: ResourceManager, batch_deployments: None
) -> None: