re-add TGI

This commit is contained in:
Victor Mustar 2024-08-29 10:59:29 +02:00
parent 1f7d04b270
commit 7cb916c7a0

View file

@ -8,6 +8,7 @@ LiteLLM supports the following types of Hugging Face models:
- Serverless Inference API (free) - loaded and ready to use: https://huggingface.co/models?inference=warm&pipeline_tag=text-generation
- Dedicated Inference Endpoints (paid) - manual deployment: https://ui.endpoints.huggingface.co/
- All LLMs served via Hugging Face's Inference use [Text-generation-inference](https://huggingface.co/docs/text-generation-inference).
## Usage