scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-28 01:32:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 43
53121 commits 2896 branches 1423 tags 3.7 GiB
Commit graph

53121 commits

This branch
This branch
All branches
Author SHA1 Message Date
yassin
d338d3f2d2 style(agents): tidy typing and docstring in access group ceiling helpers
Some checks failed
LiteLLM Rust / rust-lint (push) Has been cancelled
Details
LiteLLM Rust / rust-test (push) Has been cancelled
Details
LiteLLM Rust / rust-wheel (push) Has been cancelled
Details
Terraform Provider / gofmt, vet, build, test (push) Has been cancelled
Details
Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (aws) (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (gcp) (push) Has been cancelled
Details 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:40:46 +00:00
yuneng
ba629f2537 test(bedrock): wrap long lines flagged by review in migrated unit tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:37:17 +00:00
yuneng
1659dec4be merge: bring main into litellm_migrate_tests_p3 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:33:02 +00:00
yassin
85da9cb588 Merge remote-tracking branch 'origin/main' into litellm_agent_access_groups 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:31:24 +00:00
kerry
ea04267912 fix(proxy): return an immutable bucket mapping from count_release_bullets 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:30:20 +00:00
yuneng-jiang
829963f86a
Merge pull request #42113 from BerriAI/litellm_unit_socket_block_at_import 
test(unit): block external sockets at import time and add a socket policy regression test
 2026-09-20 02:29:28 -07:00
ryan
a90d852d37 test(proxy): type monkeypatch and cover every DB-overridable callback params key 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:26:30 +00:00
yuneng
03a650c8a9 test: migrate wave 1 phase 1 legacy tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:17:57 +00:00
yassin
65bf78b567 fix(proxy): build Redis spend-log rows as tuples and pin the LTRIM window in the pipeline test 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:16:50 +00:00
ryan
6c13e0912b fix(proxy): apply DB-stored callback redaction settings before logger init 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:10:41 +00:00
yucheng
99e14efb62 refactor(policy_engine): accept any sequence of policy names in condition matching 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:09:27 +00:00
yuneng
bbfa853d84 test(ci): annotate new test locals as Final 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:07:51 +00:00
yucheng
ef55eb6bdf fix(policy_engine): ignore inapplicable non-default attachments when selecting defaults 
A non-default attachment whose policy is missing or whose condition does not match the request
no longer suppresses default attachments. The impact preview marks default counts as an upper bound

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:07:08 +00:00
yassin
b415f2263a test(proxy): restore pipeline methods on expiring Redis fake after merge
Some checks failed
LiteLLM Rust / rust-lint (push) Has been cancelled
Details
LiteLLM Rust / rust-test (push) Has been cancelled
Details
LiteLLM Rust / rust-wheel (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (aws) (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (gcp) (push) Has been cancelled
Details
Terraform Provider / gofmt, vet, build, test (push) Has been cancelled
Details
Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled
Details 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:59:46 +00:00
yassin
14cb7c65c2 Merge remote-tracking branch 'origin/main' into litellm_lit7351_reservation_lease_renewal 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

# Conflicts:
#	litellm/proxy/spend_tracking/budget_reservation.py
 2026-09-20 08:53:59 +00:00
yassin
6764a99410 Merge remote-tracking branch 'origin/main' into litellm_keep_config_models_on_empty_config_read
Some checks failed
LiteLLM Rust / rust-lint (push) Has been cancelled
Details
LiteLLM Rust / rust-test (push) Has been cancelled
Details
LiteLLM Rust / rust-wheel (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (aws) (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (gcp) (push) Has been cancelled
Details
Terraform Provider / gofmt, vet, build, test (push) Has been cancelled
Details
Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled
Details
2026-09-20 08:53:04 +00:00
yassin
31caa98a41 Merge remote-tracking branch 'origin/main' into litellm_agent_access_groups 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>

# Conflicts:
#	tests/test_litellm/proxy/auth/test_auth_checks.py
 2026-09-20 08:52:45 +00:00
yassin
9e53ee5f04 Merge remote-tracking branch 'origin/main' into litellm_redis_durable_spend_log_buffer 2026-09-20 08:52:32 +00:00
Claude
d43fa7425b
test(google): boot the unified Google proxy fixture with a real master key 
#42019 made the proxy refuse to start on a publicly known master key, and the
session fixture in tests/unified_google_tests started its in-process proxy with
sk-1234, so six tests errored in setup before reaching a provider

Give the fixture, the config it loads, and the SDK client the same non-default
key instead of the override the other harnesses took, so the boot check stays
live in this suite
 2026-09-20 08:48:39 +00:00
kerry
a36a62a7f9 Merge remote-tracking branch 'origin/main' into litellm_upgrade_banner_changelog_stats 2026-09-20 08:44:11 +00:00
yucheng
7fc114c24f feat(policy_engine): add default fallback policy attachments 
A policy attachment with default: true applies only when no non-default
attachment matches the request, so an opt-in guardrail policy replaces the
fallback one instead of running alongside it. Supported in config.yaml,
/policies/attachments, the Admin UI Attachments tab and the resolver
(matched_via is prefixed with default:).

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:39:03 +00:00
yuneng
decb28f5b5 test(unit): restore live router and runtime model cost state between unit tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:34:55 +00:00
yucheng
29bd2ceb2b fix(proxy): avoid mutable shutdown wait set
Some checks failed
LiteLLM Rust / rust-lint (push) Has been cancelled
Details
LiteLLM Rust / rust-test (push) Has been cancelled
Details
LiteLLM Rust / rust-wheel (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (aws) (push) Has been cancelled
Details
Terraform Modules / fmt, validate, test (gcp) (push) Has been cancelled
Details
Terraform Provider / gofmt, vet, build, test (push) Has been cancelled
Details
Terraform Provider / Provider endpoints vs proxy OpenAPI schema (push) Has been cancelled
Details 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:27:06 +00:00
yuneng
9850cd14f7 test(ci): prove RULE_CODES by running every checker rule 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:27:02 +00:00
Yuneng Jiang
129c4a703b
fix(proxy): only warn about the deprecated flag when it came from the CLI 
USE_V2_MIGRATION_RESOLVER=true is a supported way to select v2, but click
sets the same parameter from that env var, so the deprecation notice fired
for environment-based config that is not deprecated. The notice now keys off
click's parameter source.

Also drops an em dash from the notice, and moves the resolver decision under
mock-free tests by making it take the env value as an argument.
 2026-09-20 01:22:31 -07:00
yuneng
cf2a9b372c test(gigachat): cover env credential fallback by its resulting auth header 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:21:51 +00:00
yucheng
0b2d52edc2 Revert "style(proxy): format cleanup shutdown tests" 
This reverts commit 39a14f39e5.
 2026-09-20 08:21:35 +00:00
Devin AI
6d327fff6f test(bedrock): keep beta headers fixture teardown off the network 2026-09-20 08:21:28 +00:00
yucheng
39a14f39e5 style(proxy): format cleanup shutdown tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:20:47 +00:00
yuneng
fcabb626ac test(unit): migrate wave 1 phase 3 anthropic, apiserpent, azure and azure_ai legacy tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:19:05 +00:00
yucheng
37ce0e47b6 Merge remote-tracking branch 'origin/main' into litellm_spend_log_cleanup_cancel_outcome 2026-09-20 08:19:03 +00:00
yuneng
ad523edb25 test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
yuneng
65a4a00958 fix(ci): excuse retired test-quality rules in the budget ratchet 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:12:39 +00:00
yuneng
feca00248c test(bedrock): isolate host AWS config in realtime and rerank unit tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:11:56 +00:00
yuneng
443c9f8385 test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:09:49 +00:00
yuneng
d47008129c test(llms): migrate phase 7 provider unit tests to tests/unit 
Move the wave 1 phase 7 batch (fireworks_ai, gemini, gigachat, github_copilot; 20 files) from tests/test_litellm to tests/unit after judging every test function under a behaviour mutation. Seven wiring or mock-echo tests that stayed green are deleted. The fireworks cost calculator tests get a local model_cost save/restore fixture since the tests/unit tree has no shared conftest for it

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:08:12 +00:00
yuneng
99c2ef4d73 test(unit): block external sockets at import time and add a socket policy regression test 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:07:50 +00:00
yuneng
4defed7f2e test: migrate wave 1 phase 8 legacy llm tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:03:54 +00:00
Yuneng Jiang
9aec964bac
Merge remote-tracking branch 'origin/main' into litellm_flip_v2_migration_resolver_default 
Drops the TQ008 suppressions the new test carried; main removed that rule.
 2026-09-20 01:02:19 -07:00
Yuneng Jiang
e05d68dbf9
Merge remote-tracking branch 'origin/main' into litellm_flip_v2_migration_resolver_default 2026-09-20 01:01:51 -07:00
yuneng
02ccdbae90 test(llms): migrate bedrock, baseten and base_llm batch tests to tests/unit 2026-09-20 07:51:50 +00:00
yuneng
522c3e3ed6 test: migrate wave 1 phase 2 legacy unit tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 07:50:43 +00:00
yuneng
b450baa402 test(llms): migrate phase 5 provider unit tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 07:50:38 +00:00
yuneng
4048062e53 test(llms): annotate local_model_cost_map fixtures in phase 6 tests 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 07:50:30 +00:00
yuneng
e1d2789d29 test(llms): migrate phase 6 provider unit tests to tests/unit 
Migrate 18 provider test files from tests/test_litellm/llms to tests/unit/llms.
194 kept tests move as-is after mutation testing; 1 test deleted
(test_completion_datarobot_with_environment_variables, env-gated no-assert);
the fixture-only fal_ai cost calculator file is removed.

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 07:50:30 +00:00
Yuneng Jiang
556c7f6b68
ci: keep real-database coverage for both migration resolvers 
The Postgres-backed smoke job previously exercised one resolver. Running
the default and the legacy variants in it covers v2 now that it is the
default, without losing v1's coverage.
 2026-09-20 00:50:05 -07:00
yuneng-jiang
6ef7b86748
Merge pull request #42103 from BerriAI/litellm_test_unit_ci_wiring 
ci(tests): wire tests/unit into CircleCI and keep draining GHA shards green
 2026-09-20 00:50:00 -07:00
yuneng-jiang
776f8bc309
Merge pull request #40932 from BerriAI/litellm_v2_migration_startup 
fix(proxy): coordinate v2 migration startup and qualify container recovery
 2026-09-20 00:21:02 -07:00
Yuneng Jiang
fac518dbf7
feat(proxy): default to the v2 migration resolver 
The migrations Job entrypoint (migrations/run.py) has defaulted to v2 with
USE_V2_MIGRATION_RESOLVER=false as the opt-out, and the Helm chart documents
that knob. Proxy startup still defaulted to v1, so the two paths disagreed
about which resolver a deployment runs.

Proxy startup now resolves the same way: v2 unless USE_V2_MIGRATION_RESOLVER
is false or --use_legacy_migration_resolver is passed.

- --use_v2_migration_resolver stays accepted as a no-op that warns, so
  existing commands and Helm values do not fail on an unknown option.
- The dedicated Postgres smoke-test job is repointed at the legacy resolver
  so v1 keeps real-DB proxy-boot coverage, and the two jobs that deselected
  it by name are updated to match the rename.

#39178 reverted an earlier flip because two replicas sharing a database
deadlocked (40P01 / P3018) with neither answering /health/liveliness. That
contention is what #40932 coordinates, which is why this builds on it.
 2026-09-20 00:12:30 -07:00
yuneng
adadeac245 Revert "ci(tests): temporarily point one shard at an empty directory" 
This reverts commit 3c094dbaaa.
 2026-09-20 07:10:43 +00:00