Krish Dholakia
523fbed233
Merge pull request #24199 from stias/fix/bedrock-count-tokens-custom-endpoint
...
fix(bedrock): respect api_base and aws_bedrock_runtime_endpoint in count_tokens endpoint
2026-03-20 09:10:30 -07:00
Seokjun Yang
d3afaf613d
Update tests/litellm_utils_tests/test_bedrock_token_counter.py
...
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-03-20 22:21:22 +09:00
Seokjun Yang
eb733702fc
Update tests/litellm_utils_tests/test_bedrock_token_counter.py
...
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-03-20 22:21:15 +09:00
Sameer Kankute
8da3efdfbe
Fix code qa and mypy lint issues
2026-03-20 18:21:01 +05:30
Sameer Kankute
4088f2b6da
Merge branch 'main' into litellm_oss_staging_03_19_2026
2026-03-20 14:46:58 +05:30
Sameer Kankute
009cbfa799
Merge pull request #24088 from Point72/ephrimstanley/limits
...
feat: add proxy-wide default api key tpm/rpm limits
2026-03-20 14:46:38 +05:30
Seokjun Yang
72902c39c5
Remove extra newline in common_utils.py
2026-03-20 18:09:52 +09:00
stias
bc4608e718
fix(bedrock): respect api_base and aws_bedrock_runtime_endpoint in count_tokens endpoint
...
The /v1/messages/count_tokens endpoint was hardcoding the Bedrock runtime
URL, ignoring api_base and aws_bedrock_runtime_endpoint settings. This
aligns it with invoke/converse handlers by using the existing
get_runtime_endpoint() method for consistent endpoint resolution.
Signed-off-by: stias <seokjun.yang@mycraft.kr>
2026-03-20 17:58:20 +09:00
Mavik
be2c679f2d
fix: resolve recursion in OVHCloud get_supported_openai_params ( #24118 )
...
* fix: resolve recursion in OVHCloud get_supported_openai_params (#24111 )
Root cause: OVHCloudChatConfig.get_supported_openai_params() called
get_model_info() which called back into get_supported_openai_params(),
causing infinite recursion and falling back to no tools support.
Made-with: Cursor
* fix: use .get() for TypedDict + don't hardcode function_calling support
Made-with: Cursor
---------
Co-authored-by: themavik <themavik@users.noreply.github.com>
2026-03-20 12:14:47 +05:30
Joe Reyna
d7c419bfee
Merge pull request #24179 from joereyna/fix/upgrade-mcp-1.26.0
...
fix: upgrade mcp to 1.26.0 and bump version to 1.82.5
2026-03-19 23:37:10 -07:00
Sameer Kankute
784f9431ad
Merge pull request #24188 from BerriAI/main
...
merge main 0319
2026-03-20 11:03:54 +05:30
joereyna
32ada454a2
fix: upgrade mcp to 1.26.0
2026-03-19 21:32:42 -07:00
yuneng-jiang
30589b06ad
Merge pull request #24187 from joereyna/fix/black-format-lint-cleanup
...
chore: apply black formatting and enable black pre-commit hook
2026-03-19 21:31:48 -07:00
joereyna
6f6e23a7b0
chore: apply black formatting to experimental_pass_through transformation
2026-03-19 21:25:02 -07:00
joereyna
ff6faacc64
fix: resolve mypy union-attr error in anthropic messages transformation
2026-03-19 21:20:12 -07:00
joereyna
c6b5c07005
chore: apply black formatting and enable black pre-commit hook
2026-03-19 21:00:54 -07:00
joereyna
e5dc912367
bump: version 1.82.4 → 1.82.5
2026-03-19 19:58:04 -07:00
Krrish Dholakia
3093ef844e
fix: document new config_settings.md
2026-03-19 18:57:02 -07:00
Krish Dholakia
48e9d0b271
Merge pull request #24140 from devin-petersohn/feat/anthropic-auth-token-and-base-url
...
feat(anthropic): support ANTHROPIC_AUTH_TOKEN and ANTHROPIC_BASE_URL env vars
2026-03-19 18:50:48 -07:00
Krish Dholakia
61dde5eb0a
Merge pull request #24143 from johnib/fix/websearch-short-circuit-copilot
...
fix: short-circuit websearch for github_copilot provider
2026-03-19 18:45:09 -07:00
Krish Dholakia
3a0652c445
Merge branch 'main' into feat/anthropic-auth-token-and-base-url
2026-03-19 18:41:19 -07:00
Krish Dholakia
2900e0e384
Merge pull request #24090 from joereyna/fix/release-notes-v1-82-3-helicone-langfuse
...
docs(release-notes): complete v1.82.3 changelog with full PR audit
2026-03-19 18:33:02 -07:00
Krish Dholakia
29647856b5
Merge branch 'main' into fix/release-notes-v1-82-3-helicone-langfuse
2026-03-19 18:32:38 -07:00
Krish Dholakia
d8b28141b9
Merge pull request #24173 from joereyna/fix/black-format-batch-3
...
chore: apply black formatting to fix lint CI (batch 3)
2026-03-19 18:27:30 -07:00
Krish Dholakia
75386d4cb9
Merge pull request #24149 from michelligabriele/fix/kill-orphaned-prisma-engine-on-reconnect
...
fix(proxy): kill orphaned prisma engine subprocess on failed disconnect
2026-03-19 18:12:58 -07:00
joereyna
87b5039aaa
chore: apply black formatting to fix lint CI (batch 3)
2026-03-19 18:11:40 -07:00
Krish Dholakia
dddccc4e5c
Merge pull request #24105 from superpoussin22/correct-migration
...
Add IF NOT EXISTS to index creation in migration
2026-03-19 18:00:07 -07:00
Krish Dholakia
482b77e71d
Merge pull request #24081 from BerriAI/litellm_oss_staging_03_18_2026
...
Litellm oss staging 03 18 2026
2026-03-19 17:58:07 -07:00
Krish Dholakia
8d92d8637d
Merge branch 'main' into litellm_oss_staging_03_18_2026
2026-03-19 17:57:55 -07:00
Krish Dholakia
d4857f682d
Merge pull request #24135 from michelligabriele/fix/deferred-guardrail-logging-v2
...
fix(proxy): defer logging until post-call guardrails complete
2026-03-19 17:57:00 -07:00
Krish Dholakia
b1731b6798
Merge pull request #24168 from BerriAI/cursor/litellm-license-key-environment-16b4
...
docs: add LiteLLM license key environment variable instructions
2026-03-19 17:35:33 -07:00
Cursor Agent
e668ca310d
docs: add LiteLLM license key environment variable instructions
...
Added a new section to the config.yaml documentation explaining how to
set the LITELLM_LICENSE environment variable for enterprise features.
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2026-03-20 00:28:21 +00:00
yuneng-jiang
35d4984033
Merge pull request #24167 from joereyna/fix/black-format-types
...
chore: apply black formatting to proxy/_types.py to fix lint CI
2026-03-19 17:25:08 -07:00
joereyna
6f1bac07e5
chore: apply black formatting to proxy/_types.py to fix lint CI
2026-03-19 17:11:04 -07:00
yuneng-jiang
0781f68b8a
Merge pull request #24150 from BerriAI/litellm_yj_march_18_2026
...
[Infra] Merge daily internal branch with main
2026-03-19 16:43:47 -07:00
yuneng-jiang
7b600cdbfe
linting
2026-03-19 16:31:50 -07:00
yuneng-jiang
f60e3cfd34
remove returning key in error message
2026-03-19 16:29:51 -07:00
Jonathan Barazany
32cb6f0cd9
fix: guard short-circuit against providers with native agentic loop
...
- Skip short-circuit for providers that have a BaseAnthropicMessagesConfig
(bedrock, vertex_ai, azure_ai, anthropic) — they use the agentic loop
which includes a follow-up LLM synthesis step. Short-circuiting would
return raw search text instead of an LLM-synthesized answer.
- Add fallback to litellm.get_llm_provider() for custom_llm_provider
derivation when litellm_params is overwritten by kwargs.
- Add test for bedrock guard.
Addresses Greptile review comments #3 and #4 .
2026-03-20 01:07:20 +02:00
yuneng-jiang
05620c87e3
[Fix] Update bulk key update tests for find_unique refactor
...
Tests were outdated after _get_and_validate_existing_key was refactored
to use prisma_client.db.litellm_verificationtoken.find_unique() and
ProxyException. Also add ProxyException handling in bulk_update_keys
error extractor so error messages aren't empty.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 15:34:44 -07:00
yuneng-jiang
2d3cff99fe
Merge pull request #24159 from joereyna/fix/add-poetry-lock-check
...
chore: add poetry check --lock to lint CI to prevent stale lockfile merges
2026-03-19 14:48:11 -07:00
joereyna
d118bf4818
chore: add poetry check --lock to lint CI to prevent stale lockfile merges
2026-03-19 14:36:02 -07:00
yuneng-jiang
e86ca7f34d
Revert "[Fix] Update tests for _get_and_validate_existing_key refactor"
...
This reverts commit cf63697703 .
2026-03-19 14:32:14 -07:00
Joe Reyna
2df965513e
Merge pull request #24153 from joereyna/fix/black-format-lint-2
...
chore: apply black formatting to fix lint CI (batch 2)
2026-03-19 12:56:48 -07:00
Krish Dholakia
739356640b
Merge pull request #24120 from BerriAI/litellm_proxy-azure-api-version-bump
...
feat(proxy): use AZURE_DEFAULT_API_VERSION for proxy --api_version default
2026-03-19 12:54:14 -07:00
yuneng-jiang
cf63697703
[Fix] Update tests for _get_and_validate_existing_key refactor
...
Tests were outdated after _get_and_validate_existing_key was refactored
to use prisma_client.db.litellm_verificationtoken.find_unique() instead
of prisma_client.get_data(), and to raise ProxyException instead of
HTTPException. Also fix bulk_update_keys error handler to extract
ProxyException.message (str(ProxyException) returns empty string).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 12:41:11 -07:00
joereyna
004d8d01f6
chore: apply black formatting to fix lint CI
2026-03-19 12:39:39 -07:00
Devin Petersohn
f784da41af
Fix get_complete_url to honour ANTHROPIC_BASE_URL in experimental passthrough
...
Co-Authored-By: Claude <noreply@anthropic.com>
2026-03-19 12:37:12 -07:00
yuneng-jiang
c2b8ba8b1b
[Fix] Resolve mypy errors in key_management_endpoints.py
...
Add None guard for prisma_client before calling update_data, and add
"unblocked" to AUDIT_ACTIONS literal type.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 12:28:56 -07:00
yuneng-jiang
dfcf978745
Merge pull request #24092 from joereyna/fix/black-format-lint
...
chore: apply black formatting to fix lint CI
2026-03-19 12:22:48 -07:00
Devin Petersohn
b7e2269942
Address review feedback: fix OAuth routing in get_auth_header and self-contained validate_environment
...
Co-Authored-By: Claude <noreply@anthropic.com>
2026-03-19 12:17:00 -07:00