scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-13 23:11:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 101

fix: cap action-filter find_many at 10k rows to avoid unbounded table scan

Browse source
This commit is contained in:
Sameer Kankute 2026-06-29 13:16:02 +05:30
parent 4d51bebf96
commit 7704572065
No known key found for this signature in database
1 changed files with 6 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
litellm/proxy/guardrails/usage_endpoints.py
View file

@ -611,11 +611,15 @@ async def guardrails_usage_logs(
if action:
# action is derived from SpendLog JSON metadata, not an index column, so we
# cannot push the filter to the DB. Fetch all matching index rows, join with
# SpendLogs, filter in Python, then slice to the requested page.
# cannot push the filter to the DB. Fetch a bounded window of index rows,
# join with SpendLogs, filter in Python, then slice to the requested page.
# Cap at 10 000 rows to avoid OOM/full-table scans; deployments with more
# matching rows in a date range should add an `action` column to the index.
_ACTION_FILTER_ROW_CAP = 10_000
all_index_rows = await SpendLogGuardrailIndexRepository(prisma_client).table.find_many(
where=where,
order={"start_time": "desc"},
take=_ACTION_FILTER_ROW_CAP,
)
if not all_index_rows:
return UsageLogsResponse(logs=[], total=0, page=page, page_size=page_size)