Tin Chi Lo
a233ba910d
feat(auto-router): configure heuristic v2 success threshold
2026-09-21 08:53:13 -07:00
Yassin Kortam
e912ebe999
Merge pull request #42152 from BerriAI/litellm_claude_code_safeguards_passthrough
...
fix(anthropic): forward safeguards and anthropic-beta unchanged on native /v1/messages
2026-09-21 10:12:44 -05:00
kerry-berri
701c2b7256
Merge pull request #34941 from BerriAI/litellm_azure_ai_mai_image_2_5_pro
2026-09-21 08:07:36 -07:00
Yassin Kortam
1ac4d7ae04
fix(anthropic): type safeguards and safeguard_results as the arrays Anthropic sends
...
Driving a real Claude Code 2.1.278 through the proxy, and a direct call to
api.anthropic.com, both show these two fields are JSON arrays on the wire rather
than objects. The request carries safeguards as
[{"type": "dangerous_tool_use", "classifier_context": {...}}] under beta
dangerous-tool-use-2026-09-03, and the 200 comes back with safeguard_results as
[{"type": "dangerous_tool_use", "status": {"type": "available", "tool_uses": {...}}}].
No runtime change: the request filter matches on TypedDict keys and never inspects
the value. The test fixtures move to the captured shapes so the regression tests
pin what the client and the provider actually exchange.
2026-09-21 09:55:09 -05:00
Yassin Kortam
32133a329c
Merge pull request #42239 from BerriAI/litellm_agentcore_a2a_message_stream
...
fix(a2a): send message/stream for Bedrock AgentCore streaming requests
2026-09-21 09:53:41 -05:00
kerry-berri
f008c018a3
Merge pull request #42243 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 4 models
2026-09-21 07:49:01 -07:00
kerry
7b2d3b36b6
fix(prices): align deepseek-v4-pro-0813 cache hit cost with cache read cost
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 14:40:46 +00:00
berriai-litellm-provider-info-sync[bot]
346ad002c8
chore(prices): sync OpenRouter prices: 4 models
...
openrouter/~deepseek/deepseek-pro-latest: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro-0813: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost, off_peak_pricing
openrouter/meta-llama/llama-3.1-70b-instruct: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token
2026-09-21 14:30:57 +00:00
kerry-berri
0d45883312
Merge pull request #42240 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 1 model
2026-09-21 07:09:26 -07:00
berriai-litellm-provider-info-sync[bot]
18ca95c3a7
chore(prices): sync OpenRouter prices: 1 model
...
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 14:00:51 +00:00
yassin
6786eb0131
fix(a2a): send message/stream for Bedrock AgentCore streaming requests
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 13:39:32 +00:00
kerry-berri
dfbdcf1c9d
Merge pull request #42234 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 1 model
2026-09-21 06:39:30 -07:00
Yassin Kortam
def37c6532
Merge pull request #42097 from BerriAI/litellm_budget_exceeded_422
...
fix(proxy): return 422 instead of 429 for BudgetExceededError
2026-09-21 08:35:30 -05:00
Yassin Kortam
502de6bed9
Merge pull request #42207 from BerriAI/litellm_helm_componentized_replica_count
...
fix(helm): render a fixed replicaCount on componentized deployments when HPA is disabled
2026-09-21 08:31:06 -05:00
berriai-litellm-provider-info-sync[bot]
6db2bce43c
chore(prices): sync OpenRouter prices: 1 model
...
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 13:30:42 +00:00
Devin AI
2888b4f5f4
fix(bedrock): whitelist regional qwen3-next keys for converse routing check
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 13:30:35 +00:00
Devin AI
d9a97d74db
fix(model_prices): add groq qwen3.6-27b deprecation date and bedrock qwen3-next regional pricing
...
Groq lists qwen/qwen3.6-27b for shutdown on 2026-09-14. Adds the six regional
Bedrock qwen.qwen3-next-80b-a3b entries priced per AWS's published regional
rates (absorbs #42191 ) with a regression test that the regional entry is used
instead of the US rate
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 13:21:50 +00:00
Devin AI
30adc1b2b9
Merge remote-tracking branch 'origin/main' into litellm_azure_ai_mai_image_2_5_pro
2026-09-21 13:20:20 +00:00
kerry-berri
0c01d297b9
Merge pull request #42227 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 2 models
2026-09-21 06:10:10 -07:00
Mateo Wang
0c1dd2cee4
Merge pull request #42220 from BerriAI/litellm_any_sweep_20260921
...
refactor(types): replace Any with proven types in 32 files
2026-09-21 06:07:47 -07:00
berriai-litellm-provider-info-sync[bot]
85e72a2e2f
chore(prices): sync OpenRouter prices: 2 models
...
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 13:00:50 +00:00
Devin AI
8795be0a65
refactor(types): replace Any with proven types in 32 files
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 10:51:46 +00:00
Mateo Wang
1cac8bd9ab
Merge pull request #42193 from BerriAI/litellm_responses_bridge_safety_identifier
...
fix(responses): forward safety_identifier through the chat completion bridge
2026-09-21 01:36:26 -07:00
Devin AI
b38504b5a6
test(e2e): assert the forwarded Converse body without requiring the model to accept safety_identifier
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 07:37:28 +00:00
Devin AI
0317903a44
ci(e2e-changed): surface failed test ids from the pytest log
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 07:16:02 +00:00
yassin
d266d7324b
fix(helm): leave spec.replicas unset unless replicaCount is explicitly configured
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 06:35:05 +00:00
yassin
333fadad6c
fix(helm): render a fixed replicaCount on componentized deployments when HPA is disabled
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 06:25:43 +00:00
Devin AI
7e0fa40fe3
test(e2e): gate the Bedrock edge capture behind a provider_edge_host opt-in
...
The Buildkite ephemeral stack runs the gateway in another pod, so it cannot reach the pytest host's provider edge. The GitHub changed-e2e lane runs gateways on the runner and sets E2E_PROVIDER_EDGE_HOST_REACHABLE
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 06:17:03 +00:00
Devin AI
ba93c7402a
test(e2e): tolerate provider retries in safety_identifier capture assertion
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 04:53:10 +00:00
Devin AI
83223885e6
fix(responses): forward safety_identifier through the chat completion bridge
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-21 04:09:59 +00:00
kerry-berri
e484a7c89c
Merge pull request #42192 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 20:39:41 -07:00
berriai-litellm-provider-info-sync[bot]
d5921713a8
chore(prices): sync OpenRouter prices: 2 models
...
openrouter/~moonshotai/kimi-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/moonshotai/kimi-k3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 03:30:42 +00:00
kerry-berri
0ece1cd426
Merge pull request #42187 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 20:09:22 -07:00
berriai-litellm-provider-info-sync[bot]
4258bd366c
chore(prices): sync OpenRouter prices: 2 models
...
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 03:00:39 +00:00
kerry-berri
946da34260
Merge pull request #42184 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 19:38:29 -07:00
berriai-litellm-provider-info-sync[bot]
2bacd6caa0
chore(prices): sync OpenRouter prices: 2 models
...
openrouter/~moonshotai/kimi-latest: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/moonshotai/kimi-k3: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 02:30:52 +00:00
yujonglee
211f4a6851
Merge pull request #42173 from BerriAI/litellm_scaffold_secrets
...
feat(rust): add typed secret managers and shared auth adapters
2026-09-20 19:15:36 -07:00
Yujong Lee
e3f69fc4d8
refactor(rust): define consistent secret lookup contracts
2026-09-20 19:08:25 -07:00
kerry-berri
9456f48427
Merge pull request #42182 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 1 model
2026-09-20 18:40:00 -07:00
berriai-litellm-provider-info-sync[bot]
acd303043b
chore(prices): sync OpenRouter prices: 1 model
...
openrouter/qwen/qwen3.8-27b: output_cost_per_token, cache_read_input_token_cost
2026-09-21 01:31:07 +00:00
kerry-berri
6f37808d44
Merge pull request #42179 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 3 models
2026-09-20 17:39:05 -07:00
berriai-litellm-provider-info-sync[bot]
a3ffc395b9
chore(prices): sync OpenRouter prices: 3 models
...
openrouter/ibm-granite/granite-4.2-8b: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/meta-llama/llama-3.1-70b-instruct: max_tokens, max_output_tokens, input_cost_per_token, output_cost_per_token
openrouter/meta-llama/llama-4-maverick: input_cost_per_token, output_cost_per_token
2026-09-21 00:31:06 +00:00
kerry-berri
5e58b76f4e
Merge pull request #42178 from BerriAI/litellm-providers/price-sync-openrouter
...
Unit Tests: Documentation Validation / documentation (push) Waiting to run
Unit Tests: Proxy DB Operations / assert-shard-coverage (push) Waiting to run
Unit Tests: Proxy DB Operations / auth-checks (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / budgets (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / custom-logging (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / db-and-spend (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / endpoints-and-responses (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / proxy-server-core (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / guardrails-hooks (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / jwt-and-keys (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / key-generation (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / logging-misc (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / proxy-runtime (push) Blocked by required conditions
Unit Tests: Proxy DB Operations / proxy-utils (push) Blocked by required conditions
Unit Tests / caching-local (push) Waiting to run
Unit Tests / core-utils (push) Waiting to run
Unit Tests / enterprise-package (push) Waiting to run
Unit Tests / enterprise-routing (push) Waiting to run
Unit Tests / integrations (push) Waiting to run
Unit Tests / All Other Providers (push) Waiting to run
Unit Tests / Vertex AI (push) Waiting to run
Unit Tests / mcp-integration (push) Waiting to run
Unit Tests / misc (push) Waiting to run
Unit Tests / proxy-auth (push) Waiting to run
Unit Tests / proxy-endpoints (push) Waiting to run
Unit Tests / proxy-extras (push) Waiting to run
Unit Tests / proxy-infra (push) Waiting to run
Unit Tests / proxy-server (push) Waiting to run
Unit Tests / responses-caching-types (push) Waiting to run
GitHub Actions Security Analysis / zizmor (push) Waiting to run
chore(prices): sync OpenRouter prices: 4 models
2026-09-20 17:09:14 -07:00
berriai-litellm-provider-info-sync[bot]
7bcb01a40c
chore(prices): sync OpenRouter prices: 4 models
...
openrouter/~deepseek/deepseek-flash-latest: max_tokens, max_output_tokens
openrouter/~z-ai/glm-flash-latest: max_tokens, max_output_tokens
openrouter/deepseek/deepseek-v4-flash: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/deepseek/deepseek-v4-pro: input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-21 00:00:57 +00:00
kerry-berri
9ab609948d
Merge pull request #42175 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 3 models
2026-09-20 16:43:57 -07:00
kerry
5ee75af908
fix(openrouter): keep glm-latest output limit at alias target value
...
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-09-20 23:34:40 +00:00
berriai-litellm-provider-info-sync[bot]
15f368060f
chore(prices): sync OpenRouter prices: 3 models
...
openrouter/~deepseek/deepseek-pro-latest: off_peak_pricing, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
openrouter/~z-ai/glm-latest: max_tokens, max_output_tokens
openrouter/deepseek/deepseek-v4-pro-0813: off_peak_pricing, input_cost_per_token, output_cost_per_token, cache_read_input_token_cost
2026-09-20 23:30:54 +00:00
Yujong Lee
82bc67b122
feat(rust): add typed secret managers and shared auth adapters
2026-09-20 16:09:20 -07:00
Yujong Lee
3fd2dd635b
refactor(rust): split auth facade from shared types
2026-09-20 15:45:38 -07:00
kerry-berri
6814373a48
Merge pull request #42169 from BerriAI/litellm-providers/price-sync-openrouter
...
chore(prices): sync OpenRouter prices: 2 models
2026-09-20 15:39:53 -07:00
