scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-12 03:48:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 57
litellm/tests/integration/proxy_config.yaml
devin-ai-integration[bot] e0398455d0
test: migrate tests/llm_translation into unit, integration and e2e tiers (#45759) 
* test: migrate selected llm translation contracts

* test: migrate anthropic completion translation tests

* test: migrate bedrock and cohere translation tests

* test: tighten bedrock translation migration

* test: migrate azure and openai model translation tests

* test: migrate openai and small-provider translation tests

* test: migrate gemini and vertex translation tests

* test: migrate optional params and rerank translation tests

* test: migrate huggingface, json and openrouter translation tests

* test: fix openrouter integration expectations

* test: migrate databricks, xai, cometapi and fireworks translation tests

* test: migrate ovhcloud, prompt and small provider translation tests

* test: split reasoning effort grid into unit and e2e

* test: migrate router and realtime guardrail translation tests

* test: migrate google interactions translation tests

* test: migrate a2a, evals, skills and hosted vllm translation tests

* test: remove remaining llm translation suite

* test: tighten migrated llm translation unit tests and land missing rows

Restores rows the first pass dropped or weakened (bedrock agentcore and openwebui thinking stream, anthropic prefix, citations and tool_choice, azure agents handler, huggingface bare api_base, optional params num_retries, alternating roles, rerank response type), replaces truthiness and call-count checks with whole-value assertions, and moves tests to the mirror file of the code they cover

* test: move cohere, databricks, fireworks and gemini rows to mirror files over mocked HTTP

Restores three TestCohereV2Transform methods the first pass nested out of collection, replaces direct transform calls with respx-backed completion calls, and drops the databricks and fireworks files that sat outside their mirror paths

* test: close lost-intent gaps found in review of the llm translation migration

Points the hosted-mock guard at the triton test's new integration path, restores exact rerank result assertions for infinity, drops the reasoning e2e fallback that passed for any multi-line answer, and adds the mixtral invoke system prompt variants, eval deletion, and async pdf url download that the legacy suite exercised

* test: assert provider acceptance in the reasoning effort e2e

The live half of the split grid proves each route accepts reasoning_effort. claude-fable-5-1 on the direct route answers without surfacing reasoning content, so a reasoning-presence check either fails on head or needs a fallback that passes for any answer. Wire shape stays covered by the unit grid

* test: cover async and stream-end paths the legacy translation suite exercised

Adds async variants for bedrock converse file and thinking content, bedrock embedding timeout and region resolution, interaction stream termination and success logging, xai reasoning token folding, and bytes chunks with a prefix before data:. Also scopes the vertex safety settings global in test_vertex_safety_settings with monkeypatch so it stops leaking into gemini request bodies on the same worker

* test: type the new llm translation e2e calls and mark moved fixture dirs as packages

* test: name the reasoning effort e2e models as module constants

* test: assert reasoning content, register the new gemini coverage ids and give the guardrail config e2e a unique name

* test: block the prompt the shared guardrail denies and drop the reasoning presence check

* test: drop the duplicate litellm import left by the main sync

---------

Co-authored-by: yuneng <yuneng@berri.ai>
2026-10-11 07:58:53 +00:00

408 lines
17 KiB
YAML
Raw Permalink Blame History

model_list:
- model_name: anthropic/claude-haiku-4-5
litellm_params:
model: anthropic/claude-haiku-4-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-sonnet-5
litellm_params:
model: anthropic/claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-opus-4-8
litellm_params:
model: anthropic/claude-opus-4-8
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-sonnet-5-5
litellm_params:
model: anthropic/claude-sonnet-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-opus-5-5
litellm_params:
model: anthropic/claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: anthropic/claude-sonnet-4-6
litellm_params:
model: anthropic/claude-sonnet-4-6
api_base: http://127.0.0.1:8191
api_key: synthetic-anthropic-key
- model_name: gemini/gemini-3.5-flash
litellm_params:
model: gemini/gemini-3.5-flash
api_base: http://127.0.0.1:8191
api_key: synthetic-gemini-key
- model_name: gemini/gemini-3.8-flash
litellm_params:
model: gemini/gemini-3.8-flash
api_base: http://127.0.0.1:8191
api_key: synthetic-gemini-key
- model_name: gemini/gemini-3.1-pro-preview
litellm_params:
model: gemini/gemini-3.1-pro-preview
api_base: http://127.0.0.1:8191
api_key: synthetic-gemini-key
- model_name: azure_ai/claude-haiku-4-5
litellm_params:
model: azure_ai/claude-haiku-4-5
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-sonnet-4-6
litellm_params:
model: azure_ai/claude-sonnet-4-6
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-sonnet-5
litellm_params:
model: azure_ai/claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-opus-4-8
litellm_params:
model: azure_ai/claude-opus-4-8
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-sonnet-5-5
litellm_params:
model: azure_ai/claude-sonnet-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: azure_ai/claude-opus-5-5
litellm_params:
model: azure_ai/claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
- model_name: bedrock/converse/us.anthropic.claude-haiku-4-5-20251001-v1:0
litellm_params:
model: bedrock/converse/us.anthropic.claude-haiku-4-5-20251001-v1:0
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-sonnet-4-6
litellm_params:
model: bedrock/converse/us.anthropic.claude-sonnet-4-6
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-sonnet-5
litellm_params:
model: bedrock/converse/us.anthropic.claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-opus-4-8
litellm_params:
model: bedrock/converse/us.anthropic.claude-opus-4-8
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-sonnet-5-5
litellm_params:
model: bedrock/converse/us.anthropic.claude-sonnet-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/converse/us.anthropic.claude-opus-5-5
litellm_params:
model: bedrock/converse/us.anthropic.claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/global.xai.grok-4.7
litellm_params:
model: bedrock/global.xai.grok-4.7
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/global.openai.gpt-6.1-sol
litellm_params:
model: bedrock/global.openai.gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: openai/gpt-5.4
litellm_params:
model: openai/gpt-5.4
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-5.6-sol
litellm_params:
model: openai/gpt-5.6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-5.6-luna
litellm_params:
model: openai/gpt-5.6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-6-luna
litellm_params:
model: openai/gpt-6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/gpt-6.1-sol
litellm_params:
model: openai/gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/responses/gpt-5.6-sol
litellm_params:
model: openai/responses/gpt-5.6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: openai/responses/gpt-6.1-sol
litellm_params:
model: openai/responses/gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-openai-key
- model_name: azure/gpt-5.4
litellm_params:
model: azure/gpt-5.4
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-5.6-sol
litellm_params:
model: azure/gpt-5.6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-5.6-luna
litellm_params:
model: azure/gpt-5.6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-6-luna
litellm_params:
model: azure/gpt-6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: azure/gpt-6.1-sol
litellm_params:
model: azure/gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-key
api_version: "2025-04-01-preview"
- model_name: bedrock/invoke/us.anthropic.claude-haiku-4-5-20251001-v1:0
litellm_params:
model: bedrock/invoke/us.anthropic.claude-haiku-4-5-20251001-v1:0
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-sonnet-4-6
litellm_params:
model: bedrock/invoke/us.anthropic.claude-sonnet-4-6
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-sonnet-5
litellm_params:
model: bedrock/invoke/us.anthropic.claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-opus-4-8
litellm_params:
model: bedrock/invoke/us.anthropic.claude-opus-4-8
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-sonnet-5-5
litellm_params:
model: bedrock/invoke/us.anthropic.claude-sonnet-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: bedrock/invoke/us.anthropic.claude-opus-5-5
litellm_params:
model: bedrock/invoke/us.anthropic.claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-key
aws_region_name: us-east-1
- model_name: vertex_ai/claude-haiku-4-5@20251001
litellm_params:
model: vertex_ai/claude-haiku-4-5@20251001
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-sonnet-4-6@default
litellm_params:
model: vertex_ai/claude-sonnet-4-6@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-sonnet-5@default
litellm_params:
model: vertex_ai/claude-sonnet-5@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-opus-4-8@default
litellm_params:
model: vertex_ai/claude-opus-4-8@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-sonnet-5-5@default
litellm_params:
model: vertex_ai/claude-sonnet-5-5@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/claude-opus-5-5@default
litellm_params:
model: vertex_ai/claude-opus-5-5@default
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/gemini-3.5-flash
litellm_params:
model: vertex_ai/gemini-3.5-flash
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/gemini-3.8-flash
litellm_params:
model: vertex_ai/gemini-3.8-flash
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: vertex_ai/gemini-3.1-pro-preview
litellm_params:
model: vertex_ai/gemini-3.1-pro-preview
api_base: http://127.0.0.1:8191
vertex_project: synthetic-vertex-project
vertex_location: global
vertex_credentials: '{"type": "external_account", "audience": "synthetic-vertex-audience", "subject_token_type": "urn:ietf:params:oauth:token-type:jwt", "token_url": "http://127.0.0.1:8190/_oauth/token", "credential_source": {"url": "http://127.0.0.1:8190/health"}}'
- model_name: bedrock_mantle/anthropic.claude-haiku-4-5
litellm_params:
model: bedrock_mantle/anthropic.claude-haiku-4-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/anthropic.claude-sonnet-5
litellm_params:
model: bedrock_mantle/anthropic.claude-sonnet-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/anthropic.claude-opus-5-5
litellm_params:
model: bedrock_mantle/anthropic.claude-opus-5-5
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-5.4
litellm_params:
model: bedrock_mantle/openai.gpt-5.4
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-5.6-sol
litellm_params:
model: bedrock_mantle/openai.gpt-5.6-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-5.6-luna
litellm_params:
model: bedrock_mantle/openai.gpt-5.6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-6-luna
litellm_params:
model: bedrock_mantle/openai.gpt-6-luna
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: bedrock_mantle/openai.gpt-6.1-sol
litellm_params:
model: bedrock_mantle/openai.gpt-6.1-sol
api_base: http://127.0.0.1:8191
api_key: synthetic-bedrock-mantle-key
aws_region_name: us-east-1
- model_name: perplexity/pplx-decider-v1-27b
litellm_params:
model: perplexity/pplx-decider-v1-27b
api_base: http://127.0.0.1:8191
api_key: synthetic-perplexity-key
- model_name: typesafe/jev-1.13.0
litellm_params:
model: typesafe/jev-1.13.0
api_base: http://127.0.0.1:8191
api_key: synthetic-typesafe-key
- model_name: openrouter/typesafe/jev-1.13
litellm_params:
model: openrouter/typesafe/jev-1.13
api_base: http://127.0.0.1:8191
api_key: synthetic-openrouter-key
- model_name: openrouter/anthropic/claude-sonnet-4
litellm_params:
model: openrouter/anthropic/claude-sonnet-4
api_base: http://127.0.0.1:8191
api_key: synthetic-openrouter-key
- model_name: openrouter/google/gemini-3.1-flash-image
litellm_params:
model: openrouter/google/gemini-3.1-flash-image
api_base: http://127.0.0.1:8191
api_key: synthetic-openrouter-key
- model_name: cloudflare/@cf/cloudflare/clef
litellm_params:
model: cloudflare/@cf/cloudflare/clef
api_base: http://127.0.0.1:8191
api_key: synthetic-cloudflare-key
- model_name: strands_decider/strands-decider-2B-hobson-v19
litellm_params:
model: strands_decider/strands-decider-2B-hobson-v19
api_base: http://127.0.0.1:8191
- model_name: hosted_vllm/Qwen/Qwen3-0.6B
litellm_params:
model: hosted_vllm/Qwen/Qwen3-0.6B
api_base: http://127.0.0.1:8191
- model_name: azure_ai/decision-1
litellm_params:
model: azure_ai/decision-1
api_base: http://127.0.0.1:8191
api_key: synthetic-azure-ai-key
model_info:
base_model: azure_ai/Microsoft-Decision-1
general_settings:
master_key: os.environ/LITELLM_MASTER_KEY
database_url: os.environ/DATABASE_URL
store_model_in_db: true
disable_model_info_refresh: true
disable_spend_logs: false
proxy_batch_write_at: 1
proxy_batch_polling_interval: 1
litellm_settings:
enable_redis_auth_cache: true
cache: true
cache_params:
type: redis
host: os.environ/REDIS_HOST
port: os.environ/REDIS_PORT
router_settings:
disable_cooldowns: true
vector_store_registry:
- vector_store_name: integration-config-store
litellm_params:
vector_store_id: vs_integration_config_store
custom_llm_provider: openai
api_base: os.environ/INTEGRATION_UPSTREAM_URL
api_key: integration-provider-key
vector_store_description: declared in tests/integration/proxy_config.yaml
environment_variables:
PERPLEXITYAI_API_KEY: synthetic-decisions-env-key
Reference in a new issue View git blame Copy permalink