mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-21 00:21:49 +00:00
vLLM serves no /v1/files or /v1/batches, so a hosted_vllm deployment can never host a batch. Batch inputs for such a deployment now land in a LiteLLM-owned storage backend, the batch is executed line by line through the deployment's own chat, completion, embedding, or responses route, and the batch plus its output and error files are served back from the database under the creating key |
||
|---|---|---|
| .. | ||
| batch_cleanup.py | ||
| batch_client.py | ||
| capabilities.py | ||
| conftest.py | ||
| COVERAGE.md | ||
| test_batch_cleanup.py | ||
| test_batches_e2e.py | ||
| test_managed_files_enforcement_e2e.py | ||