mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-08 22:21:35 +00:00
08bea8d0dd
The mateo-berri PAT now arrives via systemd LoadCredential as a file instead of the EnvironmentFile, so pytest, the proxy, and the model-driven claude CLI never inherit it and a same-UID /proc read cannot lift it. run_daily.sh reads the credential when present, still accepts an exported GITHUB_TOKEN for manual runs, and dies up front when publishing is enabled with neither. Full CLI sandboxing is tracked in LIT-5420
68 lines
2.9 KiB
Text
68 lines
2.9 KiB
Text
# Environment file consumed by `litellm-compat-matrix.service`.
|
|
#
|
|
# Install at `/etc/litellm-compat-matrix.env` and chmod 0600.
|
|
# `EnvironmentFile=-` in the unit means the service is allowed to start
|
|
# even if this file is missing, but the populator will fail at the
|
|
# first provider request without these credentials.
|
|
|
|
# Anthropic
|
|
ANTHROPIC_API_KEY=
|
|
|
|
# Bedrock (invoke + converse columns; also bedrock_mantle when enabled).
|
|
# Use Anthropic's Bedrock API-key passthrough (long-lived bearer token).
|
|
# No AWS_ACCESS_KEY_ID/AWS_SECRET_ACCESS_KEY required for the matrix --
|
|
# both the LiteLLM invoke and converse routes pick up
|
|
# AWS_BEARER_TOKEN_BEDROCK when present.
|
|
AWS_BEARER_TOKEN_BEDROCK=
|
|
AWS_REGION_NAME=us-east-1
|
|
|
|
# Vertex AI (vertex_ai + vertex_ai_gpt columns).
|
|
# On the GCP VM, the default service-account ADC from the metadata server
|
|
# is used -- no JSON key file is needed. If you ever need to run outside
|
|
# GCP, also export GOOGLE_APPLICATION_CREDENTIALS=/path/to/sa.json.
|
|
VERTEXAI_PROJECT=
|
|
VERTEXAI_LOCATION=global
|
|
|
|
# Azure AI Foundry (azure column — Claude models on Foundry)
|
|
AZURE_AI_API_KEY=
|
|
AZURE_AI_API_BASE=
|
|
|
|
# OpenAI (openai GPT column)
|
|
OPENAI_API_KEY=
|
|
|
|
# Azure OpenAI (azure_openai GPT column)
|
|
AZURE_API_BASE=
|
|
AZURE_API_KEY=
|
|
|
|
# The publish PAT (mateo-berri, write access on BerriAI/litellm-docs)
|
|
# deliberately does NOT live in this file. Everything here lands in the
|
|
# process environment of pytest, the proxy, and the model-driven claude
|
|
# CLI, where any same-UID reader can lift it from /proc/<pid>/environ.
|
|
# Instead, install the token at /etc/litellm-compat-matrix-github-token
|
|
# (chmod 0600, single line); the service maps it in via systemd
|
|
# LoadCredential and run_daily.sh keeps it out of every child process
|
|
# env. Used to (a) resolve the latest stable release, (b) push the
|
|
# daily compat-matrix branch directly to BerriAI/litellm-docs, (c) open
|
|
# the same-repo PR, and (d) enable squash auto-merge on it. Scopes:
|
|
# classic `repo` + `workflow`, or fine-grained on BerriAI/litellm-docs
|
|
# with Contents:RW + Pull requests:RW + Workflows:RW.
|
|
# Manual runs export GITHUB_TOKEN instead, or skip publishing entirely
|
|
# with SKIP_PUBLISH=1 (only writes the matrix JSON locally).
|
|
|
|
# Optional: the bedrock_mantle column is opt-in because the AWS account
|
|
# needs the Mantle (OpenAI-on-Bedrock) models enabled. Without this the
|
|
# mantle cells are skipped and recorded as not_tested rather than fail.
|
|
# COMPAT_MANTLE_CELLS=1
|
|
|
|
# Optional: the openai column is likewise opt-in; its cells hit CLI
|
|
# timeouts under the concurrent stage suite, but the serial cron can
|
|
# usually run them. Skipped cells are recorded as not_tested.
|
|
# COMPAT_OPENAI_GPT_CELLS=1
|
|
|
|
# Optional overrides; defaults are sensible for the cron VM.
|
|
# PROXY_PORT=4100
|
|
# LITELLM_WORKTREE=/home/mateo/litellm-cron-worktree
|
|
# DOCS_REPO=BerriAI/litellm-docs
|
|
# DOCS_BRANCH=main
|
|
# DOCS_TARGET_PATH=src/data/compatibility-matrix.json
|
|
# AUTO_MERGE_METHOD=squash
|