litellm/enterprise/litellm_enterprise/proxy/hooks
mateo-berri a61bceb0cf fix(files): read storage-backed managed files from their storage backend
The managed files hook's content read looped the file's model mappings and asked each deployment for the file. A file LiteLLM stored itself maps every model to its storage url, so the read sent that internal id to the upstream server, failed, and the batch rate limiter failed open: a key's TPM limit did not apply to a LiteLLM-executed batch. The hook now returns the stored bytes from the file's storage backend before it consults any deployment
2026-09-19 14:00:51 -07:00
..
__init__.py fix(lint): bring basedpyright rule counts back under their budget limits 2026-08-05 10:23:02 -07:00
managed_files.py fix(files): read storage-backed managed files from their storage backend 2026-09-19 14:00:51 -07:00
managed_vector_stores.py refactor(typing): replace Any with proven types in 89 more backend files 2026-09-02 23:08:42 +00:00