scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-27 01:22:18 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 80
51785 commits 2844 branches 1422 tags 3.6 GiB
Commit graph

13394 commits

Author SHA1 Message Date
yuneng
432cf517ce Merge remote-tracking branch 'origin/main' into litellm_migrate_tests_p14 2026-09-20 12:54:59 +00:00
yuneng
a69ca90ea5 test: migrate phase 14 wave 2 provider tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 11:01:40 +00:00
yuneng-jiang
bfc805b372
Merge pull request #42109 from BerriAI/litellm_migrate_tests_p5 
test(llms): migrate phase 5 provider unit tests to tests/unit
 2026-09-20 04:00:48 -07:00
yuneng-jiang
766f6fcd3a
Merge pull request #42112 from BerriAI/litellm_migrate_tests_p8 
test: migrate wave 1 phase 8 legacy llm tests to tests/unit
 2026-09-20 03:59:36 -07:00
yuneng-jiang
4852d71606
Merge pull request #42114 from BerriAI/litellm_migrate_tests_p7 
test(llms): migrate phase 7 provider unit tests to tests/unit
 2026-09-20 03:59:28 -07:00
yuneng-jiang
9e39c751ed
Merge pull request #42117 from BerriAI/litellm_migrate_tests_p9 
test: migrate phase 9 legacy llm provider tests to tests/unit
 2026-09-20 03:13:33 -07:00
yuneng-jiang
e08df02ebe
Merge pull request #42115 from BerriAI/litellm_migrate_tests_p10 
test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit
 2026-09-20 03:13:07 -07:00
yuneng-jiang
53ba9f389f
Merge pull request #42107 from BerriAI/litellm_migrate_tests_p6 
test(llms): migrate phase 6 provider unit tests to tests/unit
 2026-09-20 03:12:59 -07:00
yuneng-jiang
5ae5727eb0
Merge pull request #42110 from BerriAI/litellm_migrate_tests_p4 
test(llms): migrate bedrock, baseten and base_llm batch tests to tests/unit
 2026-09-20 03:12:49 -07:00
yuneng-jiang
c198cd2cf9
Merge pull request #42108 from BerriAI/litellm_migrate_tests_p2 
test: migrate wave 1 phase 2 legacy unit tests to tests/unit
 2026-09-20 03:12:39 -07:00
yuneng
bbfa853d84 test(ci): annotate new test locals as Final 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 09:07:51 +00:00
yuneng
9850cd14f7 test(ci): prove RULE_CODES by running every checker rule 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:27:02 +00:00
yuneng
ad523edb25 test: migrate phase 9 legacy llm provider tests to tests/unit 2026-09-20 08:13:11 +00:00
yuneng
65a4a00958 fix(ci): excuse retired test-quality rules in the budget ratchet 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:12:39 +00:00
yuneng
443c9f8385 test: migrate nvidia, oci, ocr, oobabooga and openai legacy tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:09:49 +00:00
yuneng
d47008129c test(llms): migrate phase 7 provider unit tests to tests/unit 
Move the wave 1 phase 7 batch (fireworks_ai, gemini, gigachat, github_copilot; 20 files) from tests/test_litellm to tests/unit after judging every test function under a behaviour mutation. Seven wiring or mock-echo tests that stayed green are deleted. The fireworks cost calculator tests get a local model_cost save/restore fixture since the tests/unit tree has no shared conftest for it

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:08:12 +00:00
yuneng
4defed7f2e test: migrate wave 1 phase 8 legacy llm tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 08:03:54 +00:00
yuneng
02ccdbae90 test(llms): migrate bedrock, baseten and base_llm batch tests to tests/unit 2026-09-20 07:51:50 +00:00
yuneng
522c3e3ed6 test: migrate wave 1 phase 2 legacy unit tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 07:50:43 +00:00
yuneng
b450baa402 test(llms): migrate phase 5 provider unit tests to tests/unit 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 07:50:38 +00:00
yuneng
e1d2789d29 test(llms): migrate phase 6 provider unit tests to tests/unit 
Migrate 18 provider test files from tests/test_litellm/llms to tests/unit/llms.
194 kept tests move as-is after mutation testing; 1 test deleted
(test_completion_datarobot_with_environment_variables, env-gated no-assert);
the fixture-only fal_ai cost calculator file is removed.

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 07:50:30 +00:00
yuneng
446bd1b250 ci(tests): wire tests/unit into CircleCI and drain legacy unit shards green 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 07:05:42 +00:00
Mateo Wang
58065d46fd
Merge pull request #42071 from BerriAI/litellm_remove_dead_telemetry_flag 2026-09-19 21:48:02 -07:00
Mateo Wang
4011367b39
Merge pull request #40986 from BerriAI/litellm_lit_7346_multi_choice_stream_guardrails 
fix(guardrails): scan each choice's tool-call arguments apart on n>1 streams and log why a rewrite was discarded
 2026-09-19 20:34:05 -07:00
Mateo Wang
9d7f77988a
Merge pull request #41974 from BerriAI/litellm_fix_startup_view_creation_race 
fix(proxy): wait for the spend-log table before creating startup views
 2026-09-19 20:33:49 -07:00
mateo-berri
19d77e2442 test(guardrails): type the recorder hook's request_data as a Mapping 2026-09-19 20:21:37 -07:00
mateo
b2e123da43 fix(proxy): drop legacy telemetry key from persisted WORKER_CONFIG before initialize 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 03:14:11 +00:00
Mateo Wang
ef7da9b49f
Merge pull request #42072 from BerriAI/litellm_mcp_cold_worker_tools_call 
fix(mcp): tools/call no longer 404s on a worker that has not served tools/list
 2026-09-19 20:04:33 -07:00
mateo-berri
327447bc10 Merge remote-tracking branch 'origin/main' into litellm_fix_startup_view_creation_race 
# Conflicts:
#	tests/test_litellm/proxy/test_proxy_server.py
 2026-09-19 20:02:33 -07:00
mateo
fdd91a347a test: drop narration comment from telemetry flag test 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 02:44:52 +00:00
Mateo Wang
b4447096e4
Merge pull request #42067 from BerriAI/litellm_genai_adapter_response_schema_tool_params 
fix(google_genai): forward response schema and tool parameters through the generateContent adapter
 2026-09-19 19:43:32 -07:00
Mateo Wang
79e25d1e96
Merge pull request #42045 from BerriAI/litellm_lit_8201_notfound_retry_policy 
fix(router): add NotFoundErrorRetries so a retry policy can pin 404 retries
 2026-09-19 19:37:45 -07:00
mateo
8e530cf819 fix: keep --telemetry as a hidden no-op so existing start commands still parse 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 02:36:59 +00:00
mateo-berri
a3e9ed34fe fix(mcp): gate the pre-call listing per tool, not per server 
A tools/call on a cold worker listed the target server once and then never
again, so a later caller whose credentials expose a wider upstream catalog
got 404 for tools the first caller never had. Gate the pre-call listing on
whether this worker already exposes the requested tool, so callers with
different catalogs no longer mask each other. Removing the per-server guard
also drops the empty-listing case that re-listed on every call.
 2026-09-19 19:29:33 -07:00
mateo-berri
5eb967d925 fix(google_genai): drop non-object tool parameters instead of forwarding them 2026-09-19 19:19:33 -07:00
Mateo Wang
5417abd586
Merge pull request #42011 from BerriAI/litellm_scrub_default_master_key 
docs: stop advertising sk-1234 as the master key in shipped configs and examples
 2026-09-19 19:05:31 -07:00
Mateo Wang
b6dd3d932c
Merge pull request #42019 from BerriAI/litellm_master_key_boot_enforcement 
feat(proxy)!: refuse to start with an unset, empty, or publicly known master key
 2026-09-19 19:04:02 -07:00
ryan-crabbe-berri
ecf17513fb refactor(proxy): rename the local development override to dangerously_permit_weak_or_unset_master_key so the name says exactly what it permits 2026-09-19 18:53:14 -07:00
mateo-berri
2e83871d54 test(guardrails): type the recorder hook's logging_obj as object 2026-09-19 18:52:28 -07:00
mateo-berri
47ebfa10a0 fix(google_genai): reuse the shared key filter for Gemini-only schema keys 2026-09-19 18:52:00 -07:00
mateo-berri
92ff54f134 fix(mcp): list a never-listed server before its first tools/call 
The startup tool-name fill skips servers whose upstream wants the caller's
own token (true_passthrough, OAuth discovery), and mcp 2 no longer runs the
list handler before an uncached tools/call, so every uvicorn worker that had
not served tools/list answered 404 "Tool not found" for prefixed tools/call
and the REST server_id route on those servers.

On a resolution miss, execute_mcp_tool now lists the prefix-matched (or
server_id-requested) server once, with the caller's credentials, through the
existing tools/list path, then resolves as before. Listing failures fall
through to the existing 404, a worker that already listed the server never
re-lists it, and a server outside the caller's allowed set is never listed.
 2026-09-19 18:49:26 -07:00
mateo
f820472488 chore: remove the dead telemetry flag from the SDK, proxy CLI and configs 
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2026-09-20 01:44:10 +00:00
mateo-berri
fba179f2c0 fix(google_genai): forward response schema and tool parameters through the generateContent adapter 2026-09-19 18:31:09 -07:00
Mateo Wang
93e39d5042
Merge pull request #42062 from BerriAI/litellm_pr38499_batch_retrieve_model_group 
fix(router): stamp model_group when retrieving a batch, so batch tokens are attributable (internal copy of #38499)
 2026-09-19 18:23:06 -07:00
Yassin Kortam
56b3422cc2
Merge pull request #42046 from BerriAI/litellm_cost_poll_404_no_cooldown 2026-09-19 18:20:27 -07:00
Yassin Kortam
755f5c535d
Merge pull request #41994 from BerriAI/litellm_redis_spend_requeue_safety 2026-09-19 18:19:57 -07:00
ryan-crabbe-berri
99f99cfb46 fix(proxy): stop the boot when the requested master key migration fails, unless allow_requests_on_db_unavailable tolerates the outage 2026-09-19 18:10:52 -07:00
mateo-berri
2a35dc5217 fix(guardrails): keep the undeliverable rewrite reason through copies and name the responses mismatch 2026-09-19 18:00:03 -07:00
mateo-berri
a114af2a26 fix(proxy): resolve the view setup gate through the search_path and set the row count before the views 2026-09-19 17:54:20 -07:00
ryan-crabbe-berri
a6c51ba3de fix(proxy): never treat plaintext that base64-decodes to nothing as a ciphertext during the master key migration 
A string such as "*" or "..." has no base64 characters, so it decoded to no bytes and read as an empty plaintext under any key. The migration would have counted it and overwritten it with a ciphertext of the empty string. Also read from the writer database instead of a read replica, report a database error during the migration instead of crashing the boot, skip columns the connected schema lacks across every schema on the search path, cap the JSON walk depth for the recursion detector, and move the boot wiring into one tested function.
 2026-09-19 17:53:17 -07:00