Commit graph

51893 commits

Author SHA1 Message Date
Pawan-Shahane
bf6b89b1cb fix(images): return 400 when /v1/images/edits has no image part
aimage_edit required image positionally while image_edit defaults it to None,
so a request with no image part died on a raw TypeError that the proxy served
as a 500. A 500 tells OpenAI-SDK clients to retry a request that can never
succeed, so four failed calls become twelve.

The async signature now matches the sync one and both share _as_image_list, so
a missing image stays an empty list rather than becoming [None]. Each provider
config already decides whether it needs an image, since image is optional for
some models, and those checks now raise BadRequestError like the dalle2 path
already did instead of a bare ValueError that mapped to 500.

Fixes #42185
2026-09-21 09:04:12 +05:30
kerry-berri
946da34260
Merge pull request #42184 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 19:38:29 -07:00
berriai-litellm-provider-info-sync[bot]
2bacd6caa0
chore(prices): sync OpenRouter prices: 2 models
openrouter/~moonshotai/kimi-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/moonshotai/kimi-k3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 02:30:52 +00:00
yujonglee
211f4a6851
Merge pull request #42173 from BerriAI/litellm_scaffold_secrets
feat(rust): add typed secret managers and shared auth adapters
2026-09-20 19:15:36 -07:00
Yujong Lee
e3f69fc4d8 refactor(rust): define consistent secret lookup contracts 2026-09-20 19:08:25 -07:00
kerry-berri
9456f48427
Merge pull request #42182 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 1 model
2026-09-20 18:40:00 -07:00
berriai-litellm-provider-info-sync[bot]
acd303043b
chore(prices): sync OpenRouter prices: 1 model
openrouter/qwen/qwen3.8-27b: output_cost_per_token, cache_read_input_token_cost
2026-09-21 01:31:07 +00:00
kerry-berri
6f37808d44
Merge pull request #42179 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 3 models
2026-09-20 17:39:05 -07:00
berriai-litellm-provider-info-sync[bot]
a3ffc395b9
chore(prices): sync OpenRouter prices: 3 models
openrouter/ibm-granite/granite-4.2-8b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/meta-llama/llama-3.1-70b-instruct: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token
openrouter/meta-llama/llama-4-maverick: input_cost_per_token, output_cost_per_token
2026-09-21 00:31:06 +00:00
kerry-berri
5e58b76f4e
Merge pull request #42178 from BerriAI/litellm-providers/price-sync-openrouter
Some checks are pending
Unit Tests: Documentation Validation / documentation (push) Waiting to run
Unit Tests: Proxy DB Operations / assert-shard-coverage (push) Waiting to run
Unit Tests: Proxy DB Operations / auth-checks (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / budgets (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / custom-logging (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / db-and-spend (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / endpoints-and-responses (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / proxy-server-core (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / guardrails-hooks (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / jwt-and-keys (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / key-generation (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / logging-misc (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / proxy-runtime (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / proxy-utils (push) Blocked by required conditions
Unit Tests / caching-local (push) Waiting to run
Unit Tests / core-utils (push) Waiting to run
Unit Tests / enterprise-package (push) Waiting to run
Unit Tests / enterprise-routing (push) Waiting to run
Unit Tests / integrations (push) Waiting to run
Unit Tests / All Other Providers (push) Waiting to run
Unit Tests / Vertex AI (push) Waiting to run
Unit Tests / mcp-integration (push) Waiting to run
Unit Tests / misc (push) Waiting to run
Unit Tests / proxy-auth (push) Waiting to run
Unit Tests / proxy-endpoints (push) Waiting to run
Unit Tests / proxy-extras (push) Waiting to run
Unit Tests / proxy-infra (push) Waiting to run
Unit Tests / proxy-server (push) Waiting to run
Unit Tests / responses-caching-types (push) Waiting to run
GitHub Actions Security Analysis / zizmor (push) Waiting to run
chore(prices): sync OpenRouter prices: 4 models
2026-09-20 17:09:14 -07:00
berriai-litellm-provider-info-sync[bot]
7bcb01a40c
chore(prices): sync OpenRouter prices: 4 models
openrouter/~deepseek/deepseek-flash-latest: max_tokens, max_output_tokens
openrouter/~z-ai/glm-flash-latest: max_tokens, max_output_tokens
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 00:00:57 +00:00
kerry-berri
9ab609948d
Merge pull request #42175 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 3 models
2026-09-20 16:43:57 -07:00
kerry
5ee75af908 fix(openrouter): keep glm-latest output limit at alias target value
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 23:34:40 +00:00
berriai-litellm-provider-info-sync[bot]
15f368060f
chore(prices): sync OpenRouter prices: 3 models
openrouter/~deepseek/deepseek-pro-latest: off_peak_pricing, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/~z-ai/glm-latest: max_tokens, max_output_tokens
openrouter/deepseek/deepseek-v4-pro-0813: off_peak_pricing, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-20 23:30:54 +00:00
Yujong Lee
82bc67b122 feat(rust): add typed secret managers and shared auth adapters 2026-09-20 16:09:20 -07:00
Yujong Lee
3fd2dd635b refactor(rust): split auth facade from shared types 2026-09-20 15:45:38 -07:00
kerry-berri
6814373a48
Merge pull request #42169 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 15:39:53 -07:00
berriai-litellm-provider-info-sync[bot]
668a89fbfd
chore(prices): sync OpenRouter prices: 2 models
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
2026-09-20 22:30:41 +00:00
yujonglee
65c6495616
Merge pull request #42165 from BerriAI/refactor-tokenizer-rs
refactor(rust): split token counter backends
2026-09-20 15:22:33 -07:00
Yujong Lee
661da87c91 fix(rust): validate tokenizer ranks and cover backend features 2026-09-20 15:13:59 -07:00
kerry-berri
e7c8928459
Merge pull request #42168 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 3 models
2026-09-20 15:13:08 -07:00
berriai-litellm-provider-info-sync[bot]
10715b1b46
chore(prices): sync OpenRouter prices: 3 models
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/~z-ai/glm-latest: max_tokens, max_output_tokens
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
2026-09-20 22:00:46 +00:00
Yujong Lee
56c5d31e73 test(rust): run fast token counter parity tests by default
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 21:52:48 +00:00
Yujong Lee
831810248a refactor(rust): keep the Python token counter on the fast backend
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 21:49:39 +00:00
kerry-berri
5483f49a4d
Merge pull request #42166 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 1 model
2026-09-20 14:40:14 -07:00
berriai-litellm-provider-info-sync[bot]
be7b7d2ade
chore(prices): sync OpenRouter prices: 1 model
openrouter/~z-ai/glm-latest: max_tokens, max_output_tokens
2026-09-20 21:30:55 +00:00
Yujong Lee
a619b765fc refactor(rust): simplify tokenizer bridge features
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 21:25:19 +00:00
Yujong Lee
9b2b3d0b90 refactor(rust): align tokenizer docs and lint
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 21:21:52 +00:00
Yujong Lee
84c26978a3 refactor(rust): split token counter backends 2026-09-20 14:10:31 -07:00
kerry-berri
3c69ad983a
Merge pull request #42164 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 14:08:42 -07:00
berriai-litellm-provider-info-sync[bot]
8a8a15af93
chore(prices): sync OpenRouter prices: 2 models
openrouter/~deepseek/deepseek-v4-flash-latest: output_cost_per_token
openrouter/deepseek/deepseek-v4-flash-0731: output_cost_per_token
2026-09-20 21:00:50 +00:00
kerry-berri
0e61ed51c0
Merge pull request #42163 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 3 models
2026-09-20 13:39:16 -07:00
berriai-litellm-provider-info-sync[bot]
83e1f0834e
chore(prices): sync OpenRouter prices: 3 models
openrouter/~deepseek/deepseek-v4-flash-latest: output_cost_per_token
openrouter/deepseek/deepseek-v4-flash-0731: output_cost_per_token
openrouter/deepseek/deepseek-v4-flash-vision-exp: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-20 20:30:54 +00:00
kerry-berri
c20135621f
Merge pull request #42162 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 12:39:29 -07:00
joshua-berri
b4d9231b31
Merge pull request #42148 from BerriAI/litellm_mcp_public_client_7740
fix(mcp): explain missing public client dependencies
2026-09-20 19:36:17 +00:00
joshua-berri
c25601fb5f
Merge pull request #42064 from BerriAI/litellm_fix_jwt_deactivated_users_8217
fix(auth): reject deactivated JWT users and refresh cached status
2026-09-20 19:35:53 +00:00
berriai-litellm-provider-info-sync[bot]
9e84b8b048
chore(prices): sync OpenRouter prices: 2 models
openrouter/~deepseek/deepseek-pro-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
2026-09-20 19:30:56 +00:00
kerry-berri
f8cc79bbcd
Merge pull request #42157 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 12:12:14 -07:00
berriai-litellm-provider-info-sync[bot]
6a8b131fbd
chore(prices): sync OpenRouter prices: 2 models
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
2026-09-20 19:00:55 +00:00
kerry-berri
d9a3381fbe
Merge pull request #42155 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 5 models
2026-09-20 11:39:42 -07:00
berriai-litellm-provider-info-sync[bot]
010a5a5b1c
chore(prices): sync OpenRouter prices: 5 models
openrouter/~anthropic/claude-fable-latest: supports_tool_choice
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/anthropic/claude-fable-5.1: supports_tool_choice
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/qwen/qwen3.6-35b-a3b: input_cost_per_token, output_cost_per_token
2026-09-20 18:30:53 +00:00
kerry-berri
f788071e1b
Merge pull request #42154 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 11:08:42 -07:00
berriai-litellm-provider-info-sync[bot]
229d5cbfcb
chore(prices): sync OpenRouter prices: 2 models
openrouter/~deepseek/deepseek-pro-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
2026-09-20 18:00:52 +00:00
yuneng-jiang
7c4b805ca0
Merge pull request #42145 from BerriAI/litellm_migrate_tests_p13
test: migrate legacy provider tests to tests/unit (wave 2, phase 13)
2026-09-20 10:50:18 -07:00
kerry-berri
ba6f543190
Merge pull request #42096 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 11 models
2026-09-20 10:39:46 -07:00
berriai-litellm-provider-info-sync[bot]
a6361dc08c
chore(prices): sync OpenRouter prices: 11 models
openrouter/~deepseek/deepseek-flash-latest: off_peak_pricing, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/~deepseek/deepseek-pro-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/~z-ai/glm-flash-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/~z-ai/glm-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/meta/muse-glimmer-30b: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token
openrouter/mistralai/mistral-small-3.1-24b-instruct: supports_tool_choice, supports_function_calling
openrouter/qwen/qwen-2.5-coder-32b-instruct: supports_response_schema
openrouter/qwen/qwen3.8-27b: input_cost_per_token, output_cost_per_token
openrouter/z-ai/glm-5.3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-20 17:30:49 +00:00
kerry-berri
af1f46af1a
Merge pull request #41980 from BerriAI/litellm_fal_seedance_video
feat(fal_ai): add Seedance 2.5 / 2.0 video generation via fal queue API
2026-09-20 10:18:48 -07:00
moe-berri
1e161f516c
Merge pull request #41879 from BerriAI/litellm_jev_test_budget_1789764884
fix(proxy): enforce virtual key budgets for JEV test routing
2026-09-20 10:10:21 -07:00
yuneng
8554d1f827 test: prepare reference input before tracing path-sourced peak
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 17:08:16 +00:00
yuneng
e3911c71f7 test: make path-sourced streaming peak test differential
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 16:24:36 +00:00