Commit graph

51925 commits

Author SHA1 Message Date
kerry
97fc8220df fix(prices): align deepseek-v4-pro-0813 off-peak and cache-hit rates with the base cache read rate
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 15:14:19 +00:00
berriai-litellm-provider-info-sync[bot]
33e64e53f9
chore(prices): sync OpenRouter prices: 4 models
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
2026-09-21 15:00:53 +00:00
Yassin Kortam
32133a329c
Merge pull request #42239 from BerriAI/litellm_agentcore_a2a_message_stream
fix(a2a): send message/stream for Bedrock AgentCore streaming requests
2026-09-21 09:53:41 -05:00
kerry-berri
f008c018a3
Merge pull request #42243 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 4 models
2026-09-21 07:49:01 -07:00
kerry
7b2d3b36b6 fix(prices): align deepseek-v4-pro-0813 cache hit cost with cache read cost
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 14:40:46 +00:00
berriai-litellm-provider-info-sync[bot]
346ad002c8
chore(prices): sync OpenRouter prices: 4 models
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/meta-llama/llama-3.1-70b-instruct: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token
2026-09-21 14:30:57 +00:00
kerry-berri
0d45883312
Merge pull request #42240 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 1 model
2026-09-21 07:09:26 -07:00
berriai-litellm-provider-info-sync[bot]
18ca95c3a7
chore(prices): sync OpenRouter prices: 1 model
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 14:00:51 +00:00
yassin
6786eb0131 fix(a2a): send message/stream for Bedrock AgentCore streaming requests
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 13:39:32 +00:00
kerry-berri
dfbdcf1c9d
Merge pull request #42234 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 1 model
2026-09-21 06:39:30 -07:00
Yassin Kortam
def37c6532
Merge pull request #42097 from BerriAI/litellm_budget_exceeded_422
fix(proxy): return 422 instead of 429 for BudgetExceededError
2026-09-21 08:35:30 -05:00
Yassin Kortam
502de6bed9
Merge pull request #42207 from BerriAI/litellm_helm_componentized_replica_count
fix(helm): render a fixed replicaCount on componentized deployments when HPA is disabled
2026-09-21 08:31:06 -05:00
berriai-litellm-provider-info-sync[bot]
6db2bce43c
chore(prices): sync OpenRouter prices: 1 model
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 13:30:42 +00:00
kerry-berri
0c01d297b9
Merge pull request #42227 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-21 06:10:10 -07:00
Mateo Wang
0c1dd2cee4
Merge pull request #42220 from BerriAI/litellm_any_sweep_20260921
refactor(types): replace Any with proven types in 32 files
2026-09-21 06:07:47 -07:00
berriai-litellm-provider-info-sync[bot]
85e72a2e2f
chore(prices): sync OpenRouter prices: 2 models
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 13:00:50 +00:00
Devin AI
8795be0a65 refactor(types): replace Any with proven types in 32 files
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 10:51:46 +00:00
Mateo Wang
1cac8bd9ab
Merge pull request #42193 from BerriAI/litellm_responses_bridge_safety_identifier
fix(responses): forward safety_identifier through the chat completion bridge
2026-09-21 01:36:26 -07:00
Devin AI
b38504b5a6 test(e2e): assert the forwarded Converse body without requiring the model to accept safety_identifier
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 07:37:28 +00:00
Devin AI
0317903a44 ci(e2e-changed): surface failed test ids from the pytest log
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 07:16:02 +00:00
yassin
d266d7324b fix(helm): leave spec.replicas unset unless replicaCount is explicitly configured
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 06:35:05 +00:00
yassin
333fadad6c fix(helm): render a fixed replicaCount on componentized deployments when HPA is disabled
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 06:25:43 +00:00
Devin AI
7e0fa40fe3 test(e2e): gate the Bedrock edge capture behind a provider_edge_host opt-in
The Buildkite ephemeral stack runs the gateway in another pod, so it cannot reach the pytest host's provider edge. The GitHub changed-e2e lane runs gateways on the runner and sets E2E_PROVIDER_EDGE_HOST_REACHABLE

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 06:17:03 +00:00
Devin AI
ba93c7402a test(e2e): tolerate provider retries in safety_identifier capture assertion
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 04:53:10 +00:00
Devin AI
83223885e6 fix(responses): forward safety_identifier through the chat completion bridge
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 04:09:59 +00:00
kerry-berri
e484a7c89c
Merge pull request #42192 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 20:39:41 -07:00
berriai-litellm-provider-info-sync[bot]
d5921713a8
chore(prices): sync OpenRouter prices: 2 models
openrouter/~moonshotai/kimi-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/moonshotai/kimi-k3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 03:30:42 +00:00
kerry-berri
0ece1cd426
Merge pull request #42187 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 20:09:22 -07:00
berriai-litellm-provider-info-sync[bot]
4258bd366c
chore(prices): sync OpenRouter prices: 2 models
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 03:00:39 +00:00
kerry-berri
946da34260
Merge pull request #42184 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 19:38:29 -07:00
berriai-litellm-provider-info-sync[bot]
2bacd6caa0
chore(prices): sync OpenRouter prices: 2 models
openrouter/~moonshotai/kimi-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/moonshotai/kimi-k3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 02:30:52 +00:00
yujonglee
211f4a6851
Merge pull request #42173 from BerriAI/litellm_scaffold_secrets
feat(rust): add typed secret managers and shared auth adapters
2026-09-20 19:15:36 -07:00
Yujong Lee
e3f69fc4d8 refactor(rust): define consistent secret lookup contracts 2026-09-20 19:08:25 -07:00
kerry-berri
9456f48427
Merge pull request #42182 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 1 model
2026-09-20 18:40:00 -07:00
berriai-litellm-provider-info-sync[bot]
acd303043b
chore(prices): sync OpenRouter prices: 1 model
openrouter/qwen/qwen3.8-27b: output_cost_per_token, cache_read_input_token_cost
2026-09-21 01:31:07 +00:00
kerry-berri
6f37808d44
Merge pull request #42179 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 3 models
2026-09-20 17:39:05 -07:00
berriai-litellm-provider-info-sync[bot]
a3ffc395b9
chore(prices): sync OpenRouter prices: 3 models
openrouter/ibm-granite/granite-4.2-8b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/meta-llama/llama-3.1-70b-instruct: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token
openrouter/meta-llama/llama-4-maverick: input_cost_per_token, output_cost_per_token
2026-09-21 00:31:06 +00:00
kerry-berri
5e58b76f4e
Merge pull request #42178 from BerriAI/litellm-providers/price-sync-openrouter
Some checks are pending
Unit Tests: Documentation Validation / documentation (push) Waiting to run
Unit Tests: Proxy DB Operations / assert-shard-coverage (push) Waiting to run
Unit Tests: Proxy DB Operations / auth-checks (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / budgets (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / custom-logging (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / db-and-spend (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / endpoints-and-responses (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / proxy-server-core (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / guardrails-hooks (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / jwt-and-keys (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / key-generation (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / logging-misc (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / proxy-runtime (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / proxy-utils (push) Blocked by required conditions
Unit Tests / caching-local (push) Waiting to run
Unit Tests / core-utils (push) Waiting to run
Unit Tests / enterprise-package (push) Waiting to run
Unit Tests / enterprise-routing (push) Waiting to run
Unit Tests / integrations (push) Waiting to run
Unit Tests / All Other Providers (push) Waiting to run
Unit Tests / Vertex AI (push) Waiting to run
Unit Tests / mcp-integration (push) Waiting to run
Unit Tests / misc (push) Waiting to run
Unit Tests / proxy-auth (push) Waiting to run
Unit Tests / proxy-endpoints (push) Waiting to run
Unit Tests / proxy-extras (push) Waiting to run
Unit Tests / proxy-infra (push) Waiting to run
Unit Tests / proxy-server (push) Waiting to run
Unit Tests / responses-caching-types (push) Waiting to run
GitHub Actions Security Analysis / zizmor (push) Waiting to run
chore(prices): sync OpenRouter prices: 4 models
2026-09-20 17:09:14 -07:00
berriai-litellm-provider-info-sync[bot]
7bcb01a40c
chore(prices): sync OpenRouter prices: 4 models
openrouter/~deepseek/deepseek-flash-latest: max_tokens, max_output_tokens
openrouter/~z-ai/glm-flash-latest: max_tokens, max_output_tokens
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 00:00:57 +00:00
kerry-berri
9ab609948d
Merge pull request #42175 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 3 models
2026-09-20 16:43:57 -07:00
kerry
5ee75af908 fix(openrouter): keep glm-latest output limit at alias target value
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 23:34:40 +00:00
berriai-litellm-provider-info-sync[bot]
15f368060f
chore(prices): sync OpenRouter prices: 3 models
openrouter/~deepseek/deepseek-pro-latest: off_peak_pricing, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/~z-ai/glm-latest: max_tokens, max_output_tokens
openrouter/deepseek/deepseek-v4-pro-0813: off_peak_pricing, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-20 23:30:54 +00:00
Yujong Lee
82bc67b122 feat(rust): add typed secret managers and shared auth adapters 2026-09-20 16:09:20 -07:00
Yujong Lee
3fd2dd635b refactor(rust): split auth facade from shared types 2026-09-20 15:45:38 -07:00
kerry-berri
6814373a48
Merge pull request #42169 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 15:39:53 -07:00
berriai-litellm-provider-info-sync[bot]
668a89fbfd
chore(prices): sync OpenRouter prices: 2 models
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
2026-09-20 22:30:41 +00:00
yujonglee
65c6495616
Merge pull request #42165 from BerriAI/refactor-tokenizer-rs
refactor(rust): split token counter backends
2026-09-20 15:22:33 -07:00
Yujong Lee
661da87c91 fix(rust): validate tokenizer ranks and cover backend features 2026-09-20 15:13:59 -07:00
kerry-berri
e7c8928459
Merge pull request #42168 from BerriAI/litellm-providers/price-sync-openrouter
chore(prices): sync OpenRouter prices: 3 models
2026-09-20 15:13:08 -07:00
berriai-litellm-provider-info-sync[bot]
10715b1b46
chore(prices): sync OpenRouter prices: 3 models
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/~z-ai/glm-latest: max_tokens, max_output_tokens
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
2026-09-20 22:00:46 +00:00