Commit graph

34410 commits

Author SHA1 Message Date
yuneng-jiang
aa4a95c889
Merge pull request #21587 from BerriAI/litellm_fix_key_delete_feb19
[Infra] Add project_id to DeletedVerificationTable
2026-02-19 10:51:28 -08:00
yuneng-jiang
6c0cc4fb4f adding build 2026-02-19 10:50:47 -08:00
Chesars
3aea9c81c9 fix(openrouter): prevent double-stripping of native model names in get_llm_provider
Move the fix to the OpenRouter level: define native OpenRouter models
(openrouter/auto, openrouter/free, openrouter/bodybuilder) and check
them in get_llm_provider() before the provider_list stripping logic.
This prevents the second strip across all bridges without modifying
each adapter/handler individually.

Fixes #16353
2026-02-19 15:50:39 -03:00
yuneng-jiang
2eded1dda6 bump: version 0.4.43 → 0.4.44 2026-02-19 10:50:23 -08:00
yuneng-jiang
a5fba84ae3
Merge pull request #21586 from BerriAI/infra_feb19
[Infra] Fixing Merge Artifacts
2026-02-19 10:47:39 -08:00
yuneng-jiang
2d928f8c54 fixing merge 2026-02-19 10:46:58 -08:00
Chesars
155bed57e8 fix(vertex_ai): pass through native Gemini imageConfig params for image generation
aspectRatio and imageSize were silently dropped because they weren't
listed in get_supported_openai_params(), so the validation layer filtered
them out before they could reach transform_image_generation_request().

Fixes #21070
2026-02-19 15:39:27 -03:00
yuneng-jiang
bac1b6b2e0
Merge pull request #21545 from BerriAI/litellm_key_last_active_tracking
[Feature] Key Last Active Tracking
2026-02-19 10:29:23 -08:00
yuneng-jiang
caa931b167 adding build 2026-02-19 10:29:01 -08:00
yuneng-jiang
9eaaa9740b bump: version 0.4.42 → 0.4.43 2026-02-19 10:28:35 -08:00
yuneng-jiang
c911cfbabf Merge remote-tracking branch 'origin' into litellm_key_last_active_tracking 2026-02-19 10:27:48 -08:00
Chesars
a185182086 fix(openai): validate logprobs/top_p against reasoning_effort for gpt-5.1/5.2
logprobs, top_p, top_logprobs are only accepted by OpenAI when
reasoning_effort="none". Add validation matching the existing
temperature logic: raise UnsupportedParamsError or drop when
reasoning_effort is set to other values.
2026-02-19 15:20:14 -03:00
Chesars
26d27803eb fix(models): disable function calling for PublicAI Apertus models
The Apertus 8B and 70B models do not support standard OpenAI-style
tool calling. Per Swiss AI's docs, tool use integration into inference
engines is still in development. Set supports_function_calling and
supports_tool_choice to false.

Fixes #21124
2026-02-19 15:17:27 -03:00
Chesars
c6240ff621 fix(azure_ai): resolve api_base from env var in get_complete_url for Document Intelligence OCR
validate_environment() resolved AZURE_DOCUMENT_INTELLIGENCE_ENDPOINT
from the env var but only returned headers. get_complete_url() still
received None and raised ValueError. Now get_complete_url() also
resolves the env var as a fallback.

Fixes #21034
2026-02-19 15:14:09 -03:00
yuneng-jiang
2df7d1770a
Merge pull request #21580 from BerriAI/proxy_extras_feb19
[Infra] bump proxy extras
2026-02-19 10:12:33 -08:00
yuneng-jiang
c3317ea2b3 build files 2026-02-19 10:11:47 -08:00
yuneng-jiang
23547df8a1 bump: version 0.4.41 → 0.4.42 2026-02-19 10:11:19 -08:00
yuneng-jiang
0465067055
Merge pull request #21579 from BerriAI/proxy_extras_feb19
bump: version 0.4.40 → 0.4.41
2026-02-19 10:07:00 -08:00
yuneng-jiang
35797d1f75 bump: version 0.4.40 → 0.4.41 2026-02-19 10:05:38 -08:00
Chesars
5596545fb9 fix(gemini): correct streaming finish_reason for tool calls
Gemini returns finishReason="STOP" even when tool calls are present,
and sends tool_calls and finishReason in separate streaming chunks.
The ModelResponseIterator now tracks tool_calls across chunks and
correctly maps finish_reason to "tool_calls" per the OpenAI spec.

Fixes #21041
2026-02-19 15:01:41 -03:00
Chesars
5c4c085353 fix(openai): correct supported_openai_params for GPT-5 model family
Remove logit_bias, modalities, prediction, audio, web_search_options
from supported params for all GPT-5 reasoning models (OpenAI rejects
them). Add logprobs, top_p, top_logprobs for gpt-5.1/5.2 which support
them when reasoning_effort="none".

Related to #21572
2026-02-19 14:56:49 -03:00
Chesars
f3f731a678 fix(openai): restrict supported params for gpt-5-search models
gpt-5-search-api models were routed through OpenAIGPT5Config which
listed params like n, temperature, tools, reasoning_effort as supported,
but OpenAI rejects all of these for search models.

Fixes #21572
2026-02-19 14:37:43 -03:00
Sameer Kankute
2e34870df9
Merge pull request #21568 from BerriAI/litellm_gemini-3.1-pro-preview_day_0
[Feat]Add gemini 3.1 pro preview day 0 support
2026-02-19 22:25:28 +05:30
jquinter
f20b5fc62a
Merge pull request #21566 from BerriAI/fix/pass-through-mypy-type-errors
fix(types): fix mypy errors in pass-through endpoint query param types
2026-02-19 13:51:39 -03:00
Sameer Kankute
c123dc5c24 Fix vercel build 2026-02-19 22:19:34 +05:30
Sameer Kankute
9f66a4c122 Fix test_reasoning_effort_dict_format_gemini_3 2026-02-19 22:14:20 +05:30
Sameer Kankute
884c763fb1 Fix date in docs 2026-02-19 22:14:20 +05:30
Sameer Kankute
a951d6c681 Update docs/my-website/blog/gemin_3.1/index.md
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-02-19 22:14:20 +05:30
Sameer Kankute
e27725a8b5 Update docs/my-website/blog/gemin_3.1/index.md
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-02-19 22:14:20 +05:30
Sameer Kankute
468be6f5a8 Fix date in docs 2026-02-19 22:14:20 +05:30
Sameer Kankute
2133a97e97 Add gemini-3.1-pro-preview pricing data 2026-02-19 22:14:19 +05:30
Sameer Kankute
8305bbee21 Add mapping for medium thinking level for gemini-3.1-pro-preview 2026-02-19 22:14:19 +05:30
Milan
83c88d5ab1 fix(router): add warning log and cleanup for credential resolution
- Add warning when credential name is not found in credential_list
- Remove litellm_credential_name from credentials dict after resolution

Addresses Greptile bot review comments on PR #21502
2026-02-19 18:09:19 +02:00
Milan
d477ddf591 trigger PR update 2026-02-19 17:40:23 +02:00
Julio Quinteros Pro
f3003a9840 fix(types): fix mypy errors in pass-through endpoint query param types
- passthrough/utils.py: change `request_query_params` from `Dict` to
  `Mapping` so callers passing `dict[str, str]` satisfy the type checker
  (dict is invariant; Mapping is covariant in its value type)
- pass_through_endpoints.py: cast `param_default_query_params` to
  `Optional[dict]` consistent with the existing cast pattern for other
  params extracted from the untyped `target_params` dict

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-02-19 12:24:14 -03:00
Milan
d80ae36e4a test(router): add test for credential name resolution
Add test to verify that get_deployment_credentials_with_provider correctly
resolves litellm_credential_name to actual credential values and removes
the credential name from the returned dictionary.
2026-02-19 17:21:01 +02:00
jquinter
ec28395054
Merge pull request #21564 from BerriAI/fix/competitor-constants-env-override
fix(constants): add env var override support for COMPETITOR_LLM_TEMPERATURE and MAX_COMPETITOR_NAMES
2026-02-19 11:51:57 -03:00
michelligabriele
053ee4826f
fix(websearch_interception): fix pre_call_deployment_hook not triggering via proxy router (#21433)
* fix(websearch_interception): fix pre_call_deployment_hook not triggering via proxy router

Fix provider lookup (check top-level kwargs + fallback to get_llm_provider),
return full kwargs dict instead of partial, and use OpenAI-format tool definition.

* remove unnecessary inline import
2026-02-19 06:38:45 -08:00
Julio Quinteros Pro
4227690025 fix(constants): add env var override support for COMPETITOR_LLM_TEMPERATURE and MAX_COMPETITOR_NAMES
These constants were added as hardcoded values in #21533 without environment
variable support, causing test_all_numeric_constants_can_be_overridden to fail.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-02-19 11:28:49 -03:00
Sameer Kankute
ca34e9a3f9
Merge pull request #21543 from BerriAI/litellm_passthrough_endpoint_method
Add method based routing for passthrough endpoints
2026-02-19 19:34:04 +05:30
Sameer Kankute
ca91814b85 rrevert changes 2026-02-19 19:33:34 +05:30
Sameer Kankute
f2393fc9cb Merge main into litellm_passthrough_endpoint_method
Resolved conflicts in pass_through_endpoints.py by:
- Accepting main's formatting and mypy fixes
- Preserving branch's method support feature
- Preserving branch's default_query_params feature

Combined changes include:
- Method filtering for passthrough endpoints
- Default query parameters support
- Updated route key format to include methods
- Code formatting improvements from main
- Fixed type annotations

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-19 19:22:41 +05:30
Sameer Kankute
647e5237a7
Merge pull request #21555 from BerriAI/litellm_server_side_compaction_trans
[Feat] Add server side compaction translation from openai to anthropic
2026-02-19 19:14:37 +05:30
Sameer Kankute
8bcca905a7
Merge pull request #21539 from BerriAI/litellm_fix_azure_store_param
Fix: add stop param as supported for openai and azure
2026-02-19 19:12:43 +05:30
Sameer Kankute
36e21830db
Merge pull request #21550 from BerriAI/litellm_add_global_usage
[Feat] Add Default usage data configuration
2026-02-19 19:10:35 +05:30
Sameer Kankute
1ad9d26c6f
Merge pull request #21559 from BerriAI/fix_openai/bge-multilingual-gemma2
Fix usage in xai
2026-02-19 19:07:09 +05:30
Sameer Kankute
308cdb2720
Merge pull request #21557 from SherifWaly/sherif.waly/add-reasoning-multi-turn-hosted-vllm
Convert thinking_blocks to content blocks for hosted_vllm multi-turn
2026-02-19 18:56:09 +05:30
Sameer Kankute
fc7fa73b6f Fix usage in xai 2026-02-19 18:48:30 +05:30
Harshit Jain
5258007e22
fix: remove old test file 2026-02-19 18:47:45 +05:30
Harshit Jain
19c8f78c2f
fix: update docker test file to right path 2026-02-19 18:44:28 +05:30