mirror of
https://github.com/BerriAI/litellm.git
synced 2026-10-07 02:59:05 +00:00
docs add vertex ai endpoints
This commit is contained in:
parent
c8438715af
commit
94e5d0f734
2 changed files with 43 additions and 2 deletions
40
docs/my-website/docs/vertex_ai.md
Normal file
40
docs/my-website/docs/vertex_ai.md
Normal file
|
|
@ -0,0 +1,40 @@
|
|||
# [BETA] Vertex AI Endpoints
|
||||
|
||||
## Supported APIs
|
||||
|
||||
- Gemini API
|
||||
- Embeddings API
|
||||
- Imagen API
|
||||
- Code Completion API
|
||||
- Batch prediction API
|
||||
- Tuning API
|
||||
- CountTokens API
|
||||
|
||||
## Quick Start Usage
|
||||
|
||||
#### 1. Set `default_vertex_config` on your `config.yaml`
|
||||
|
||||
|
||||
Add the following credentials to your litellm config.yaml to use the Vertex AI endpoints.
|
||||
|
||||
```yaml
|
||||
default_vertex_config:
|
||||
vertex_project: "adroit-crow-413218"
|
||||
vertex_location: "us-central1"
|
||||
vertex_credentials: "/Users/ishaanjaffer/Downloads/adroit-crow-413218-a956eef1a2a8.json" # Add path to service account.json
|
||||
```
|
||||
|
||||
#### 2. Start litellm proxy
|
||||
|
||||
```shell
|
||||
litellm --config /path/to/config.yaml
|
||||
```
|
||||
|
||||
#### 3. Test it
|
||||
|
||||
```shell
|
||||
curl http://localhost:4000/vertex-ai/publishers/google/models/textembedding-gecko@001:countTokens \
|
||||
-H "Content-Type: application/json" \
|
||||
-H "Authorization: Bearer sk-1234" \
|
||||
-d '{"instances":[{"content": "gm"}]}'
|
||||
```
|
||||
|
|
@ -110,7 +110,7 @@ const sidebars = {
|
|||
},
|
||||
{
|
||||
type: "category",
|
||||
label: "Embedding(), Image Generation(), Assistants(), Moderation(), Audio Transcriptions(), TTS(), Batches(), Fine-Tuning()",
|
||||
label: "Supported Endpoints - /images, /audio/speech, /assistants etc",
|
||||
items: [
|
||||
"embedding/supported_embedding",
|
||||
"embedding/async_embedding",
|
||||
|
|
@ -121,7 +121,8 @@ const sidebars = {
|
|||
"assistants",
|
||||
"batches",
|
||||
"fine_tuning",
|
||||
"anthropic_completion"
|
||||
"anthropic_completion",
|
||||
"vertex_ai"
|
||||
],
|
||||
},
|
||||
{
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue