scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-11-08 08:08:37 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 80
litellm/tests/integration/proxy_config.yaml
Devin Gupta 216041e243
feat(decisions): add Parallel AI web-grounded decisions (#49188) 
* feat(decisions): add Parallel AI web-grounded decisions

* fix(decisions): name the Parallel model decision

* fix(parallel_ai): restrict environment credentials to trusted decision endpoints

* fix(decisions): keep Parallel evidence fields off other providers and handle missing confidence

Only fields a provider names reach the OpenAI response, so existing providers keep
their base shape. A malformed api_base answers 400 on both credential paths. The
complexity router classifier and the Playground handle a provider that omits
confidence. Regenerates the lazy OpenAPI snapshot and the dashboard API types

* chore(cost-map): declare the Decisions routes on parallel_ai/decision

The provider endpoint files are generated from the cost map, so the row must
name both routes for the generated System One flag to hold

* fix(decisions): report no classifier confidence when a provider omits it

A choice answer with no confidence is a valid classifier answer, so the
complexity router picks its tier and leaves classifier_confidence and the
confidence signal out instead of reporting a different metric in its place.

Also show the Parallel AI logo in the provider picker and add a Parallel
translation fixture captured from the live API for both Decisions routes.

* fix(decisions): keep a token-priced row on token billing when it also sets a query price

A plain input_cost_per_query bills flat only on a row with no token price, and input_cost_per_query_decisions always bills flat, so a custom Decisions row that already bills tokens costs the same as before this PR

* fix(decisions): bill a deployment's query price and accept Parallel bases that end in a route

A proxy request logs through an object built before the router picks the deployment, so a query price on litellm_params never reached Decisions billing. Parallel Search accepts a base ending in /v1/search and shares PARALLEL_AI_API_BASE with Decisions, so Decisions now accepts that base and one ending in /v1/decisions.

* fix(decisions): keep per-query billing and optional confidence on Parallel only

A query price on any other Decisions provider moved that provider off token
billing, and a choice or score answer with no confidence became a 200 with a
null for every provider. Both now apply to Parallel alone, so other providers
bill and fail as they do on main.

A Parallel deployment with explicit zero token rates and a query price read as
free, so every budget check was skipped while it billed per call. It now counts
as priced.

The dashboard key for Parallel is now PARALLEL_AI so a served bundle that
predates the provider still sends parallel_ai as the provider slug, and the
README table lists the provider.

---------

Co-authored-by: mateo-berri <277851410+mateo-berri@users.noreply.github.com>
2026-11-03 04:47:02 +00:00

679 lines
28 KiB
YAML
Raw Blame History

model_list:
- model_name: bedrock/converse/global.anthropic.claude-haiku-4-5-20251001-v1:0
litellm_params:
model: bedrock/converse/global.anthropic.claude-haiku-4-5-20251001-v1:0
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: bedrock/converse/global.anthropic.claude-haiku-5-5
litellm_params:
model: bedrock/converse/global.anthropic.claude-haiku-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: openai/gpt-5-mini
litellm_params:
model: openai/gpt-5-mini
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
- model_name: openai/gpt-5.4-mini
litellm_params:
model: openai/gpt-5.4-mini
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
- model_name: bedrock/converse/global.openai.gpt-5.6-luna
litellm_params:
model: bedrock/converse/global.openai.gpt-5.6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: bedrock/converse/global.openai.gpt-6-luna
litellm_params:
model: bedrock/converse/global.openai.gpt-6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: anthropic/claude-opus-5
litellm_params:
model: anthropic/claude-opus-5
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
- model_name: bedrock/converse/global.anthropic.claude-opus-5
litellm_params:
model: bedrock/converse/global.anthropic.claude-opus-5
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: vertex_ai/claude-opus-5@default
litellm_params:
model: vertex_ai/claude-opus-5@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience",
"subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token",
"credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: bedrock/converse/global.anthropic.claude-opus-5-5
litellm_params:
model: bedrock/converse/global.anthropic.claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: bedrock/converse/global.openai.gpt-5.6-sol
litellm_params:
model: bedrock/converse/global.openai.gpt-5.6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: openai/gpt-6-sol
litellm_params:
model: openai/gpt-6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
- model_name: bedrock/converse/global.openai.gpt-6-sol
litellm_params:
model: bedrock/converse/global.openai.gpt-6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: bedrock/converse/global.openai.gpt-6.1-sol
litellm_params:
model: bedrock/converse/global.openai.gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: bedrock/converse/global.openai.gpt-5.6-terra
litellm_params:
model: bedrock/converse/global.openai.gpt-5.6-terra
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: anthropic/claude-fable-5
litellm_params:
model: anthropic/claude-fable-5
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
- model_name: bedrock/converse/global.anthropic.claude-fable-5
litellm_params:
model: bedrock/converse/global.anthropic.claude-fable-5
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: vertex_ai/claude-fable-5@default
litellm_params:
model: vertex_ai/claude-fable-5@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience",
"subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token",
"credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: bedrock/converse/global.anthropic.claude-fable-5-1
litellm_params:
model: bedrock/converse/global.anthropic.claude-fable-5-1
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: bedrock/converse/global.openai.gpt-6-astra
litellm_params:
model: bedrock/converse/global.openai.gpt-6-astra
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
aws_region_name: us-east-1
- model_name: azure/gpt-5.4-mini
litellm_params:
model: azure/gpt-5.4-mini
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
api_version: 2025-04-01-preview
- model_name: azure_ai/claude-fable-5
litellm_params:
model: azure_ai/claude-fable-5
api_base: http://127.0.0.1:8191
api_key: synthetic-agent-key
- model_name: anthropic/claude-haiku-4-5
litellm_params:
model: anthropic/claude-haiku-4-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-haiku-5-5
litellm_params:
model: anthropic/claude-haiku-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-sonnet-5
litellm_params:
model: anthropic/claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-opus-4-8
litellm_params:
model: anthropic/claude-opus-4-8
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-sonnet-5-5
litellm_params:
model: anthropic/claude-sonnet-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-opus-5-5
litellm_params:
model: anthropic/claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-fable-5-1
litellm_params:
model: anthropic/claude-fable-5-1
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-sonnet-4-6
litellm_params:
model: anthropic/claude-sonnet-4-6
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: gemini/gemini-3.5-flash
litellm_params:
model: gemini/gemini-3.5-flash
api_base: http://127.0.0.1:8191
api_key: synthetic-gemini-key
- model_name: gemini/gemini-3.8-flash
litellm_params:
model: gemini/gemini-3.8-flash
api_base: http://127.0.0.1:8191
api_key: synthetic-gemini-key
- model_name: gemini/gemini-3.1-pro-preview
litellm_params:
model: gemini/gemini-3.1-pro-preview
api_base: http://127.0.0.1:8191
api_key: synthetic-gemini-key
- model_name: gemini/gemini-4-argon
litellm_params:
model: gemini/gemini-4-argon
api_base: http://127.0.0.1:8191
api_key: synthetic-gemini-key
- model_name: azure_ai/claude-haiku-4-5
litellm_params:
model: azure_ai/claude-haiku-4-5
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-haiku-5-5
litellm_params:
model: azure_ai/claude-haiku-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-sonnet-4-6
litellm_params:
model: azure_ai/claude-sonnet-4-6
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-sonnet-5
litellm_params:
model: azure_ai/claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-opus-4-8
litellm_params:
model: azure_ai/claude-opus-4-8
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-sonnet-5-5
litellm_params:
model: azure_ai/claude-sonnet-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-opus-5-5
litellm_params:
model: azure_ai/claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-fable-5-1
litellm_params:
model: azure_ai/claude-fable-5-1
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: bedrock/converse/us.anthropic.claude-haiku-4-5-20251001-v1:0
litellm_params:
model: bedrock/converse/us.anthropic.claude-haiku-4-5-20251001-v1:0
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-haiku-5-5
litellm_params:
model: bedrock/converse/us.anthropic.claude-haiku-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-sonnet-4-6
litellm_params:
model: bedrock/converse/us.anthropic.claude-sonnet-4-6
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-sonnet-5
litellm_params:
model: bedrock/converse/us.anthropic.claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-opus-4-8
litellm_params:
model: bedrock/converse/us.anthropic.claude-opus-4-8
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-sonnet-5-5
litellm_params:
model: bedrock/converse/us.anthropic.claude-sonnet-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-opus-5-5
litellm_params:
model: bedrock/converse/us.anthropic.claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-fable-5-1
litellm_params:
model: bedrock/converse/us.anthropic.claude-fable-5-1
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/global.xai.grok-4.7
litellm_params:
model: bedrock/global.xai.grok-4.7
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/global.openai.gpt-6.1-sol
litellm_params:
model: bedrock/global.openai.gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: openai/gpt-5.4
litellm_params:
model: openai/gpt-5.4
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-5.6-sol
litellm_params:
model: openai/gpt-5.6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-5.6-luna
litellm_params:
model: openai/gpt-5.6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-6-luna
litellm_params:
model: openai/gpt-6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-6.1-sol
litellm_params:
model: openai/gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-6-astra
litellm_params:
model: openai/gpt-6-astra
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-5.6-terra
litellm_params:
model: openai/gpt-5.6-terra
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/responses/gpt-5.6-sol
litellm_params:
model: openai/responses/gpt-5.6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/responses/gpt-6.1-sol
litellm_params:
model: openai/responses/gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: contract-affinity-responses
litellm_params:
model: openai/responses/gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
provider_affinity_header: x-session-affinity
- model_name: contract-affinity-anthropic
litellm_params:
model: anthropic/claude-sonnet-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
provider_affinity_header: x-session-affinity
- model_name: azure/gpt-5.4
litellm_params:
model: azure/gpt-5.4
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-5.6-sol
litellm_params:
model: azure/gpt-5.6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-5.6-luna
litellm_params:
model: azure/gpt-5.6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-6-luna
litellm_params:
model: azure/gpt-6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-6.1-sol
litellm_params:
model: azure/gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-6-astra
litellm_params:
model: azure/gpt-6-astra
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-5.6-terra
litellm_params:
model: azure/gpt-5.6-terra
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: bedrock/invoke/us.anthropic.claude-haiku-4-5-20251001-v1:0
litellm_params:
model: bedrock/invoke/us.anthropic.claude-haiku-4-5-20251001-v1:0
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-haiku-5-5
litellm_params:
model: bedrock/invoke/us.anthropic.claude-haiku-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-sonnet-4-6
litellm_params:
model: bedrock/invoke/us.anthropic.claude-sonnet-4-6
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-sonnet-5
litellm_params:
model: bedrock/invoke/us.anthropic.claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-opus-4-8
litellm_params:
model: bedrock/invoke/us.anthropic.claude-opus-4-8
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-sonnet-5-5
litellm_params:
model: bedrock/invoke/us.anthropic.claude-sonnet-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-opus-5-5
litellm_params:
model: bedrock/invoke/us.anthropic.claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-fable-5-1
litellm_params:
model: bedrock/invoke/us.anthropic.claude-fable-5-1
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: vertex_ai/claude-haiku-4-5@20251001
litellm_params:
model: vertex_ai/claude-haiku-4-5@20251001
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-sonnet-4-6@default
litellm_params:
model: vertex_ai/claude-sonnet-4-6@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-sonnet-5@default
litellm_params:
model: vertex_ai/claude-sonnet-5@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-opus-4-8@default
litellm_params:
model: vertex_ai/claude-opus-4-8@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-sonnet-5-5@default
litellm_params:
model: vertex_ai/claude-sonnet-5-5@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-haiku-5-5@default
litellm_params:
model: vertex_ai/claude-haiku-5-5@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-opus-5-5@default
litellm_params:
model: vertex_ai/claude-opus-5-5@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-fable-5-1@default
litellm_params:
model: vertex_ai/claude-fable-5-1@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/gemini-3.5-flash
litellm_params:
model: vertex_ai/gemini-3.5-flash
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/gemini-3.8-flash
litellm_params:
model: vertex_ai/gemini-3.8-flash
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/gemini-3.1-pro-preview
litellm_params:
model: vertex_ai/gemini-3.1-pro-preview
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/gemini-4-argon
litellm_params:
model: vertex_ai/gemini-4-argon
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: bedrock_mantle/anthropic.claude-haiku-4-5
litellm_params:
model: bedrock_mantle/anthropic.claude-haiku-4-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/anthropic.claude-sonnet-5
litellm_params:
model: bedrock_mantle/anthropic.claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/anthropic.claude-opus-5-5
litellm_params:
model: bedrock_mantle/anthropic.claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-5.4
litellm_params:
model: bedrock_mantle/openai.gpt-5.4
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-5.6-sol
litellm_params:
model: bedrock_mantle/openai.gpt-5.6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-5.6-luna
litellm_params:
model: bedrock_mantle/openai.gpt-5.6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-6-luna
litellm_params:
model: bedrock_mantle/openai.gpt-6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-6.1-sol
litellm_params:
model: bedrock_mantle/openai.gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-6-astra
litellm_params:
model: bedrock_mantle/openai.gpt-6-astra
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-5.6-terra
litellm_params:
model: bedrock_mantle/openai.gpt-5.6-terra
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: perplexity/pplx-decider-v1-27b
litellm_params:
model: perplexity/pplx-decider-v1-27b
api_base: http://127.0.0.1:8191
api_key: synthetic-perplexity-key
- model_name: parallel_ai/decision
litellm_params:
model: parallel_ai/decision
api_base: http://127.0.0.1:8191
api_key: synthetic-parallel-key
- model_name: typesafe/jev-1.13.0
litellm_params:
model: typesafe/jev-1.13.0
api_base: http://127.0.0.1:8191
api_key: synthetic-typesafe-key
- model_name: openrouter/typesafe/jev-1.13
litellm_params:
model: openrouter/typesafe/jev-1.13
api_base: http://127.0.0.1:8191
api_key: synthetic-openrouter-key
- model_name: fireworks_ai/accounts/fireworks/routers/rune
litellm_params:
model: fireworks_ai/accounts/fireworks/routers/rune
api_base: http://127.0.0.1:8191
api_key: synthetic-fireworks-key
- model_name: openrouter/anthropic/claude-sonnet-4
litellm_params:
model: openrouter/anthropic/claude-sonnet-4
api_base: http://127.0.0.1:8191
api_key: synthetic-openrouter-key
- model_name: openrouter/google/gemini-3.1-flash-image
litellm_params:
model: openrouter/google/gemini-3.1-flash-image
api_base: http://127.0.0.1:8191
api_key: synthetic-openrouter-key
- model_name: cloudflare/@cf/cloudflare/clef
litellm_params:
model: cloudflare/@cf/cloudflare/clef
api_base: http://127.0.0.1:8191
api_key: synthetic-cloudflare-key
- model_name: strands_decider/strands-decider-2B-hobson-v19
litellm_params:
model: strands_decider/strands-decider-2B-hobson-v19
api_base: http://127.0.0.1:8191
- model_name: hosted_vllm/Qwen/Qwen3-0.6B
litellm_params:
model: hosted_vllm/Qwen/Qwen3-0.6B
api_base: http://127.0.0.1:8191
- model_name: azure_ai/decision-1
litellm_params:
model: azure_ai/decision-1
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
model_info:
base_model: azure_ai/Microsoft-Decision-1
- model_name: azure_ai/decision-1-entra
litellm_params:
model: azure_ai/decision-1
api_base: os.environ/INTEGRATION_UPSTREAM_URL
azure_ad_token: synthetic-decisions-entra-token
model_info:
base_model: azure_ai/Microsoft-Decision-1
- model_name: azure_ai/decision-1-no-credentials
litellm_params:
model: azure_ai/decision-1
api_base: os.environ/INTEGRATION_UPSTREAM_URL
model_info:
base_model: azure_ai/Microsoft-Decision-1
general_settings:
master_key: os.environ/LITELLM_MASTER_KEY
database_url: os.environ/DATABASE_URL
store_model_in_db: true
disable_model_info_refresh: true
disable_spend_logs: false
proxy_batch_write_at: 1
proxy_batch_polling_interval: 1
litellm_settings:
enable_redis_auth_cache: true
cache: true
cache_params:
type: redis
host: os.environ/REDIS_HOST
port: os.environ/REDIS_PORT
router_settings:
disable_cooldowns: true
vector_store_registry:
- vector_store_name: integration-config-store
litellm_params:
vector_store_id: vs_integration_config_store
custom_llm_provider: openai
api_base: os.environ/INTEGRATION_UPSTREAM_URL
api_key: integration-provider-key
vector_store_description: declared in tests/integration/proxy_config.yaml
environment_variables:
PERPLEXITYAI_API_KEY: synthetic-decisions-env-key
Reference in a new issue View git blame Copy permalink