From 7cb916c7a02e5f7d425b9212ee79c7eb565967f6 Mon Sep 17 00:00:00 2001 From: Victor Mustar Date: Thu, 29 Aug 2024 10:59:29 +0200 Subject: [PATCH] re-add TGI --- docs/my-website/docs/providers/huggingface.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/my-website/docs/providers/huggingface.md b/docs/my-website/docs/providers/huggingface.md index 0599f876e9a..cf3ae5f2397 100644 --- a/docs/my-website/docs/providers/huggingface.md +++ b/docs/my-website/docs/providers/huggingface.md @@ -8,6 +8,7 @@ LiteLLM supports the following types of Hugging Face models: - Serverless Inference API (free) - loaded and ready to use: https://huggingface.co/models?inference=warm&pipeline_tag=text-generation - Dedicated Inference Endpoints (paid) - manual deployment: https://ui.endpoints.huggingface.co/ +- All LLMs served via Hugging Face's Inference use [Text-generation-inference](https://huggingface.co/docs/text-generation-inference). ## Usage