litellm/.github
Yujong Lee dc097107b2
Some checks are pending
Cost map pins recheck / rerun-cost-map-guard (push) Waiting to run
LiteLLM Rust DB / db-queries (push) Waiting to run
LiteLLM Rust / rust-lint (push) Waiting to run
LiteLLM Rust / rust-test (push) Waiting to run
LiteLLM Rust / rust-wheel (push) Waiting to run
Terraform Modules / fmt, validate, test (aws) (push) Waiting to run
Terraform Modules / fmt, validate, test (gcp) (push) Waiting to run
Terraform Provider / gofmt, vet, build, test (push) Waiting to run
Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Waiting to run
feat(db): add the SQLx pool foundation with the writer pool
NativeDatabase.connect opens a lazy SQLx writer pool from an Endpoint that
Python resolves from the final DATABASE_URL, read the way Prisma reads it:
Unix socket host, sslmode / sslaccept / sslcert with Prisma's verification
rules (prefer + strict asks the server once whether it offers TLS),
sslidentity / sslpassword handed over as PEM, schema, options, pgbouncer mode,
pool_timeout (0 waits forever) and socket_timeout. Options SQLx cannot send
are logged instead of failing boot

ConnectionBudget splits each worker's connection_limit between Prisma and the
native pool, so the budget an operator sized never grows. The Rust share is the
hard-coded RUST_RESERVED_CONNECTIONS and no setting names Rust, SQLx or Prisma.
It is 0 until a ported query needs the pool, so Prisma's URL is exactly what it
was, no native pool opens and nothing connects through SQLx. A connection_limit
that is not a positive integer is never split and goes to Prisma as before.
Once the share is above 0 Prisma keeps at least one connection, and pools are
tagged litellm-prisma and litellm-native in pg_stat_activity. Python keeps
minting RDS IAM and Entra tokens and hands each one to the pool

statement_cache_size sets the native statement cache (Prisma's default 100) and
pgbouncer=true turns it off. sqlx-postgres 0.9.0 still names every statement when
the cache is off, so Statements runs queries unnamed in that case, like Prisma,
until a release carries transact-rs/sqlx#4337. An application_name the operator
set is used on both pools

The SQL query files are pinned to LF so Windows checkouts hash them like .sqlx,
and the crate lists .sqlx in its package include so the core sdist builds offline

crates/db/AGENTS.md tracks parity with the Python Prisma stack

The bridge now links litellm-db, so the editable install compiles its queries.
The Rust DB workflow builds that install from the checked-in .sqlx metadata,
since it runs before the migrations that the online check needs
2026-11-13 16:50:02 +09:00
..
actions ci: stop PR runs from thrashing the Actions cache and stop smoke compiling from source (#51343) 2026-11-11 23:52:32 -08:00
assets/scaledown feat(scaledown): add native text provider support (#44168) 2026-10-10 14:01:17 -07:00
codeql ci(codeql): run the default suite on full scans and security-extended on PRs (#45149) 2026-10-07 13:24:28 -07:00
e2e-stack test(mcp): replace the live Linear MCP OAuth e2e tests with integration coverage (#47154) 2026-10-17 14:29:59 -07:00
ISSUE_TEMPLATE ci: classify new issues into domain, provider, kind, priority and lift labels 2026-09-18 11:37:55 -07:00
linters chore: move config and docs off the repo root (#50966) 2026-11-11 18:29:35 -08:00
observatory Add observatory test workflow for RC/stable releases 2026-03-01 15:30:09 -03:00
packaging chore: move workspace packages under litellm (#51000) 2026-11-12 04:19:57 +00:00
pr-assets feat(ui): manage customer organization, team, and member settings (#51507) 2026-11-12 20:29:07 -05:00
prompts ci: classify new issues into domain, provider, kind, priority and lift labels 2026-09-18 11:37:55 -07:00
PULL_REQUEST_TEMPLATE docs(pr-template): require rerunnable proof setup and collapsed long output (#50258) 2026-11-05 13:24:50 -08:00
screenshots fix(team_endpoints): auto-add SSO team members to org on move (proxy admin only) (#26377) 2026-04-24 08:36:25 -07:00
scripts chore: move scripts and runtime sources under litellm (#51006) 2026-11-12 04:19:57 +00:00
semgrep/rules chore: move config and docs off the repo root (#50966) 2026-11-11 18:29:35 -08:00
workflows feat(db): add the SQLx pool foundation with the writer pool 2026-11-13 16:50:02 +09:00
AGENTS.md ci: remove CircleCI (#50950) 2026-11-11 15:38:27 -08:00
ci-coverage-allowlist.yml chore: move workspace packages under litellm (#51000) 2026-11-12 04:19:57 +00:00
codecov.yml chore: move workspace packages under litellm (#51000) 2026-11-12 04:19:57 +00:00
CODEOWNERS chore: move scripts and runtime sources under litellm (#51006) 2026-11-12 04:19:57 +00:00
CONTRIBUTING.md chore: move scripts and runtime sources under litellm (#51006) 2026-11-12 04:19:57 +00:00
dependabot.yaml chore: fixes 2026-04-05 01:30:57 -07:00
deploy-on-aws.png feat: add LiteLLM Rust workspace with Mistral OCR bridge (#31033) 2026-06-23 13:16:47 -07:00
deploy-on-gcp.png feat: add LiteLLM Rust workspace with Mistral OCR bridge (#31033) 2026-06-23 13:16:47 -07:00
deploy-to-aws.png Add files via upload 2023-10-25 16:33:53 -07:00
FUNDING.yml Update FUNDING.yml 2023-09-22 09:51:35 -07:00
gitguardian.yaml chore: move scripts and runtime sources under litellm (#51006) 2026-11-12 04:19:57 +00:00
grype.yaml chore: move config and docs off the repo root (#50966) 2026-11-11 18:29:35 -08:00
issue-labels.json ci(issue-classifier): name every workflow, script and job after the issue it works on 2026-09-18 11:37:55 -07:00
mutmut-coverage.rc fix(ci): let the mutation workflow find covered lines so it generates mutants 2026-08-25 23:16:40 -07:00
osv-scanner.toml chore: move config and docs off the repo root (#50966) 2026-11-11 18:29:35 -08:00
SECURITY.md chore: move config and docs off the repo root (#50966) 2026-11-11 18:29:35 -08:00
template.yaml fix(proxy): drop legacy telemetry key from persisted WORKER_CONFIG before initialize 2026-09-20 03:14:11 +00:00