mirror of
https://github.com/fabro-sh/fabro.git
synced 2026-10-09 03:20:56 +00:00
Document Venice model integration
This commit is contained in:
Bryan Helmkamp
parent
ded92a215d
commit
ff1ca976c3
3 changed files with 130 additions and 0 deletions
|
|
@ -174,6 +174,10 @@ Provider `billing_policy` defaults from `adapter` and controls usage-cost estima
|
|||
Provider fields in configuration, APIs, and model routing are provider ID strings. Built-in names like `anthropic`, `openai`, and `gemini` still work, but custom IDs like `proxy` work anywhere a provider ID is accepted.
|
||||
</Note>
|
||||
|
||||
### Venice
|
||||
|
||||
Fabro ships a built-in [Venice](/integrations/venice) provider with a curated catalog of Venice-hosted Kimi, Grok, GLM, DeepSeek, and Qwen models. Store its API key with `fabro provider login --provider venice`. Pin `provider = "venice"` when a shared model slug must use Venice instead of a higher-priority direct provider.
|
||||
|
||||
### Poolside
|
||||
|
||||
Fabro ships a built-in [Poolside](/integrations/poolside) provider for Laguna S 2.1 and Laguna XS 2.1 over Poolside's OpenAI-compatible API. Store a direct API key with `fabro provider login --provider poolside`. The same model slugs are also available through the opt-in OpenRouter provider; its vendor-namespaced strings remain provider-only `api_id` values.
|
||||
|
|
|
|||
|
|
@ -97,6 +97,7 @@
|
|||
"integrations/litellm",
|
||||
"integrations/bedrock",
|
||||
"integrations/deepseek",
|
||||
"integrations/venice",
|
||||
"integrations/poolside",
|
||||
"integrations/openrouter",
|
||||
"integrations/modal",
|
||||
|
|
|
|||
125
docs/public/integrations/venice.mdx
Normal file
125
docs/public/integrations/venice.mdx
Normal file
|
|
@ -0,0 +1,125 @@
|
|||
---
|
||||
title: "Venice"
|
||||
description: "Run Kimi, Grok, GLM, DeepSeek, and Qwen models through Venice"
|
||||
---
|
||||
|
||||
[Venice](https://venice.ai/) provides an OpenAI-compatible API for hosted text models. Fabro enables the `venice` provider in its built-in catalog and maps stable Fabro model slugs to Venice's API model IDs.
|
||||
|
||||
## Prerequisites
|
||||
|
||||
- A Venice account
|
||||
- An inference API key from [venice.ai/settings/api](https://venice.ai/settings/api)
|
||||
- A running Fabro server
|
||||
|
||||
## Configure credentials
|
||||
|
||||
Store the API key in the target Fabro server vault:
|
||||
|
||||
```bash
|
||||
fabro provider login --provider venice
|
||||
|
||||
# For a non-default remote server:
|
||||
fabro provider login --server https://your-fabro.example --provider venice
|
||||
|
||||
# Or set the vault token directly:
|
||||
fabro secret set VENICE_API_KEY
|
||||
fabro secret --server https://your-fabro.example set VENICE_API_KEY
|
||||
```
|
||||
|
||||
Standalone SDK usage outside a Fabro server can use an env-backed credential source explicitly:
|
||||
|
||||
```bash
|
||||
export VENICE_API_KEY=<api-key>
|
||||
```
|
||||
|
||||
Fabro sends bearer-authenticated Chat Completions requests to `https://api.venice.ai/api/v1`.
|
||||
|
||||
## Included models
|
||||
|
||||
| Fabro model slug | Venice API ID | Context | Max output | Role and aliases |
|
||||
|---|---|---:|---:|---|
|
||||
| `kimi-k3` | `kimi-k3` | 1,000,000 | 131,072 | Alias `kimi` |
|
||||
| `kimi-k3-fast` | `kimi-k3-fast-api` | 1,000,000 | 131,072 | Alias `kimi-fast` |
|
||||
| `grok-4.6` | `grok-4-6` | 500,000 | 32,000 | Aliases `grok`, `grok46`, `grok-46` |
|
||||
| `glm-5.3` | `z-ai-glm-5-3` | 1,000,000 | 131,072 | Aliases `glm`, `glm5`, `glm53`, `glm5.3`, `glm-5-3` |
|
||||
| `deepseek-v4-flash` | `deepseek-v4-flash-0731` | 1,000,000 | 32,768 | Provider default; aliases `deepseek`, `deepseek-v4`, `deepseek-flash` |
|
||||
| `deepseek-v4-pro` | `deepseek-v4-pro-0813` | 1,000,000 | 32,768 | Alias `deepseek-pro` |
|
||||
| `qwen3.8-max` | `qwen-3-8-max` | 1,000,000 | 131,072 | Aliases `qwen`, `qwen-max`, `qwen3.8`, `qwen-3.8`, `qwen38`, `qwen-3.8-max`, `qwen38-max` |
|
||||
| `qwen3.8-27b` | `qwen-3-8-27b` | 262,144 | 131,072 | Aliases `qwen-27b`, `qwen-3.8-27b`, `qwen38-27b` |
|
||||
|
||||
Venice API IDs are also valid provider-scoped selectors. Fabro persists the stable Fabro slug and the selected provider when it creates a run.
|
||||
|
||||
## Select Venice explicitly
|
||||
|
||||
Some Venice models use the same stable slugs as direct providers. An unqualified selector chooses the highest-priority ready provider. For example, `deepseek` can select the direct DeepSeek provider when both API keys are configured.
|
||||
|
||||
Pin Venice when the run must use Venice:
|
||||
|
||||
```bash
|
||||
fabro model list --provider venice
|
||||
fabro model test --provider venice --model deepseek-v4-flash --deep
|
||||
fabro run workflow.fabro --provider venice --model deepseek-v4-flash
|
||||
```
|
||||
|
||||
In a workflow stylesheet:
|
||||
|
||||
```dot title="workflow.fabro"
|
||||
digraph Example {
|
||||
graph [
|
||||
model_stylesheet="
|
||||
* { provider: venice; model: deepseek-v4-flash; }
|
||||
.complex { provider: venice; model: qwen; }
|
||||
.fast { provider: venice; model: kimi-fast; }
|
||||
"
|
||||
]
|
||||
|
||||
start [shape=Mdiamond, label="Start"]
|
||||
work [label="Implement", class="complex"]
|
||||
check [label="Check", class="fast"]
|
||||
exit [shape=Msquare, label="Exit"]
|
||||
|
||||
start -> work -> check -> exit
|
||||
}
|
||||
```
|
||||
|
||||
The generic Qwen aliases `qwen` and `qwen3.8` select Qwen 3.8 Max. Use a size-specific alias such as `qwen-27b` to select Qwen 3.8 27B.
|
||||
|
||||
## Capabilities and reasoning
|
||||
|
||||
All included models support tool calling and reasoning. Kimi K3, Kimi K3 Fast, Grok 4.6, Qwen 3.8 Max, and Qwen 3.8 27B also accept image input.
|
||||
|
||||
Fabro exposes native reasoning-effort controls only when Venice supports them:
|
||||
|
||||
| Model | Reasoning effort values |
|
||||
|---|---|
|
||||
| `grok-4.6` | `low`, `medium`, `high`, `xhigh` |
|
||||
| `glm-5.3` | `low`, `high`, `max` |
|
||||
| `deepseek-v4-flash` | `low`, `high`, `max` |
|
||||
| `qwen3.8-27b` | `low`, `medium`, `xhigh` |
|
||||
|
||||
The other models reason by default but do not expose a Venice reasoning-effort control. Fabro omits sampling parameters for Kimi and DeepSeek because those routes do not use them with their configured reasoning behavior.
|
||||
|
||||
## Pricing and prompt caching
|
||||
|
||||
The built-in catalog uses Venice's published prices per million tokens:
|
||||
|
||||
| Model | Uncached input | Cache hit | Output |
|
||||
|---|---:|---:|---:|
|
||||
| `kimi-k3` | $3.75 | $0.375 | $18.75 |
|
||||
| `kimi-k3-fast` | $4.50 | $0.45 | $22.50 |
|
||||
| `grok-4.6` | $2.27 | $0.57 | $6.80 |
|
||||
| `glm-5.3` | $1.75 | $0.325 | $5.50 |
|
||||
| `deepseek-v4-flash` | $0.175 | $0.035 | $0.35 |
|
||||
| `deepseek-v4-pro` | $1.65 | $0.165 | $4.95 |
|
||||
| `qwen3.8-max` | $2.50 | $0.3125 | $7.50 |
|
||||
| `qwen3.8-27b` | $0.45 | n/a | $3.20 |
|
||||
|
||||
Fabro reports cached input separately when Venice returns cache usage for the selected model. Prices and model availability can change upstream; use `fabro model list --provider venice` to inspect the catalog shipped with your Fabro version and the [Venice model catalog](https://docs.venice.ai/models/overview) for the current upstream service.
|
||||
|
||||
## Troubleshooting
|
||||
|
||||
**"No credential was found for provider 'venice'"** — Store `VENICE_API_KEY` in the server vault with `fabro provider login --provider venice`. Pass `--server` when configuring a remote Fabro server.
|
||||
|
||||
**A shared model used another provider** — Pin Venice with `--provider venice` or `provider: venice` in the workflow stylesheet. Unqualified selectors use provider priority.
|
||||
|
||||
**A Venice API model ID is rejected without a provider** — Use the stable Fabro slug for portable selection, or qualify the API ID with the provider, such as `venice:qwen-3-8-max`.
|
||||
Loading…
Add table
Reference in a new issue