docs add vertex ai endpoints

This commit is contained in:
Ishaan Jaff 2024-08-03 17:41:45 -07:00
parent c8438715af
commit 94e5d0f734
2 changed files with 43 additions and 2 deletions

View file

@ -0,0 +1,40 @@
# [BETA] Vertex AI Endpoints
## Supported APIs
- Gemini API
- Embeddings API
- Imagen API
- Code Completion API
- Batch prediction API
- Tuning API
- CountTokens API
## Quick Start Usage
#### 1. Set `default_vertex_config` on your `config.yaml`
Add the following credentials to your litellm config.yaml to use the Vertex AI endpoints.
```yaml
default_vertex_config:
vertex_project: "adroit-crow-413218"
vertex_location: "us-central1"
vertex_credentials: "/Users/ishaanjaffer/Downloads/adroit-crow-413218-a956eef1a2a8.json" # Add path to service account.json
```
#### 2. Start litellm proxy
```shell
litellm --config /path/to/config.yaml
```
#### 3. Test it
```shell
curl http://localhost:4000/vertex-ai/publishers/google/models/textembedding-gecko@001:countTokens \
-H "Content-Type: application/json" \
-H "Authorization: Bearer sk-1234" \
-d '{"instances":[{"content": "gm"}]}'
```

View file

@ -110,7 +110,7 @@ const sidebars = {
},
{
type: "category",
label: "Embedding(), Image Generation(), Assistants(), Moderation(), Audio Transcriptions(), TTS(), Batches(), Fine-Tuning()",
label: "Supported Endpoints - /images, /audio/speech, /assistants etc",
items: [
"embedding/supported_embedding",
"embedding/async_embedding",
@ -121,7 +121,8 @@ const sidebars = {
"assistants",
"batches",
"fine_tuning",
"anthropic_completion"
"anthropic_completion",
"vertex_ai"
],
},
{