mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-13 08:52:02 +00:00
dc097107b2
Some checks are pending
Cost map pins recheck / rerun-cost-map-guard (push) Waiting to run
LiteLLM Rust DB / db-queries (push) Waiting to run
LiteLLM Rust / rust-lint (push) Waiting to run
LiteLLM Rust / rust-test (push) Waiting to run
LiteLLM Rust / rust-wheel (push) Waiting to run
Terraform Modules / fmt, validate, test (aws) (push) Waiting to run
Terraform Modules / fmt, validate, test (gcp) (push) Waiting to run
Terraform Provider / gofmt, vet, build, test (push) Waiting to run
Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Waiting to run
NativeDatabase.connect opens a lazy SQLx writer pool from an Endpoint that Python resolves from the final DATABASE_URL, read the way Prisma reads it: Unix socket host, sslmode / sslaccept / sslcert with Prisma's verification rules (prefer + strict asks the server once whether it offers TLS), sslidentity / sslpassword handed over as PEM, schema, options, pgbouncer mode, pool_timeout (0 waits forever) and socket_timeout. Options SQLx cannot send are logged instead of failing boot ConnectionBudget splits each worker's connection_limit between Prisma and the native pool, so the budget an operator sized never grows. The Rust share is the hard-coded RUST_RESERVED_CONNECTIONS and no setting names Rust, SQLx or Prisma. It is 0 until a ported query needs the pool, so Prisma's URL is exactly what it was, no native pool opens and nothing connects through SQLx. A connection_limit that is not a positive integer is never split and goes to Prisma as before. Once the share is above 0 Prisma keeps at least one connection, and pools are tagged litellm-prisma and litellm-native in pg_stat_activity. Python keeps minting RDS IAM and Entra tokens and hands each one to the pool statement_cache_size sets the native statement cache (Prisma's default 100) and pgbouncer=true turns it off. sqlx-postgres 0.9.0 still names every statement when the cache is off, so Statements runs queries unnamed in that case, like Prisma, until a release carries transact-rs/sqlx#4337. An application_name the operator set is used on both pools The SQL query files are pinned to LF so Windows checkouts hash them like .sqlx, and the crate lists .sqlx in its package include so the core sdist builds offline crates/db/AGENTS.md tracks parity with the Python Prisma stack The bridge now links litellm-db, so the editable install compiles its queries. The Rust DB workflow builds that install from the checked-in .sqlx metadata, since it runs before the migrations that the online check needs
110 lines
3.2 KiB
YAML
110 lines
3.2 KiB
YAML
name: LiteLLM Rust DB
|
|
|
|
on:
|
|
push:
|
|
paths:
|
|
- "litellm/rust/crates/db/**"
|
|
- "litellm/rust/Cargo.toml"
|
|
- "litellm/rust/Cargo.lock"
|
|
- "litellm/rust/clippy.toml"
|
|
- "litellm/proxy-extras/litellm_proxy_extras/migrations/**"
|
|
- "**/schema.prisma"
|
|
- "litellm/rust/.cargo/**"
|
|
- "litellm/rust/rust-toolchain.toml"
|
|
- "pyproject.toml"
|
|
- "uv.lock"
|
|
- ".github/actions/setup-uv-with-retries/**"
|
|
- ".github/workflows/test-rust-db.yml"
|
|
pull_request:
|
|
branches:
|
|
- main
|
|
- "litellm_**"
|
|
paths:
|
|
- "litellm/rust/crates/db/**"
|
|
- "litellm/rust/Cargo.toml"
|
|
- "litellm/rust/Cargo.lock"
|
|
- "litellm/rust/clippy.toml"
|
|
- "litellm/proxy-extras/litellm_proxy_extras/migrations/**"
|
|
- "**/schema.prisma"
|
|
- "litellm/rust/.cargo/**"
|
|
- "litellm/rust/rust-toolchain.toml"
|
|
- "pyproject.toml"
|
|
- "uv.lock"
|
|
- ".github/actions/setup-uv-with-retries/**"
|
|
- ".github/workflows/test-rust-db.yml"
|
|
|
|
permissions:
|
|
contents: read
|
|
|
|
concurrency:
|
|
group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
|
|
cancel-in-progress: true
|
|
|
|
env:
|
|
CARGO_TERM_COLOR: always
|
|
CARGO_INCREMENTAL: "0"
|
|
|
|
jobs:
|
|
db-queries:
|
|
runs-on: ubuntu-latest
|
|
timeout-minutes: 30
|
|
services:
|
|
postgres:
|
|
image: postgres:16.6@sha256:557fea37a744d5f4c8faab304b0a90858b53ab119735a88c131fd19dab802f36
|
|
env:
|
|
POSTGRES_DB: litellm
|
|
POSTGRES_PASSWORD: postgres
|
|
POSTGRES_USER: postgres
|
|
ports:
|
|
- 5432:5432
|
|
options: >-
|
|
--health-cmd "pg_isready -U postgres -d litellm"
|
|
--health-interval 10s
|
|
--health-timeout 5s
|
|
--health-retries 5
|
|
env:
|
|
DATABASE_URL: postgresql://postgres:postgres@localhost:5432/litellm
|
|
SQLX_OFFLINE: "false"
|
|
defaults:
|
|
run:
|
|
working-directory: litellm/rust
|
|
steps:
|
|
- uses: actions/checkout@08eba0b27e820071cde6df949e0beb9ba4906955 # v4.3.0
|
|
with:
|
|
persist-credentials: false
|
|
|
|
- uses: actions/setup-python@a26af69be951a213d495a4c3e4e4022e16d87065 # v5.6.0
|
|
with:
|
|
python-version: "3.12"
|
|
|
|
- uses: ./.github/actions/setup-uv-with-retries
|
|
with:
|
|
version: "0.10.9"
|
|
|
|
- run: rustup toolchain install --no-self-update
|
|
|
|
- uses: Swatinem/rust-cache@6323deb102c322ba6fcbdcafc7e3dddab59af2b6 # v2.9.2
|
|
with:
|
|
workspaces: litellm/rust
|
|
cache-on-failure: true
|
|
save-if: ${{ github.ref == 'refs/heads/main' }}
|
|
|
|
- name: Install Python dependencies
|
|
working-directory: .
|
|
env:
|
|
SQLX_OFFLINE: "true"
|
|
run: uv sync --frozen --extra extra-proxy
|
|
|
|
- name: Deploy Prisma migrations
|
|
working-directory: .
|
|
run: uv run --no-sync prisma migrate deploy --schema litellm/proxy-extras/litellm_proxy_extras/schema.prisma
|
|
|
|
- name: Install SQLx CLI
|
|
run: cargo install sqlx-cli --version 0.9.0 --locked --no-default-features -F postgres
|
|
|
|
- name: Check SQLx query metadata
|
|
working-directory: litellm/rust/crates/db
|
|
run: cargo sqlx prepare --check
|
|
|
|
- name: Test database queries
|
|
run: cargo test -p litellm-db --locked -- --include-ignored
|