mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-07 08:26:10 +00:00
re-add TGI
This commit is contained in:
parent
1f7d04b270
commit
7cb916c7a0
1 changed files with 1 additions and 0 deletions
|
|
@ -8,6 +8,7 @@ LiteLLM supports the following types of Hugging Face models:
|
|||
|
||||
- Serverless Inference API (free) - loaded and ready to use: https://huggingface.co/models?inference=warm&pipeline_tag=text-generation
|
||||
- Dedicated Inference Endpoints (paid) - manual deployment: https://ui.endpoints.huggingface.co/
|
||||
- All LLMs served via Hugging Face's Inference use [Text-generation-inference](https://huggingface.co/docs/text-generation-inference).
|
||||
|
||||
## Usage
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue