Kris Xia
5e00a49e7f
fix(streaming): normalize status code extraction to prevent 4xx errors from triggering mid-stream fallback ( #18698 )
...
在流式处理错误时，添加状态码标准化逻辑，确保 4xx 客户端错误直接抛出而不是被包装成 MidStreamFallbackError。
- 新增 _normalize_status_code 函数用于从异常对象提取状态码
- 优先从异常的 status_code 属性获取，其次从 response.status_code 获取
- 当映射异常或原始异常的状态码在 400-499 范围内时，直接抛出映射异常
- 添加单元测试验证 Vertex AI 400 错误正确抛出为 BadRequestError
- 确保流式处理中的客户端错误能够正确传播，而不会触发回退机制
2026-01-06 23:41:23 +05:30
Cesar Garcia
01b6925610
Merge branch 'main' into litellm_ui_custom_proxy_base_url
2026-01-06 12:34:25 -03:00
Chesars
cd38e1c9de
Scope custom proxy base to Playground
2026-01-06 12:17:22 -03:00
Wiley Kestner
9e6714fe1b
Tally total_tokens in response if missing ( #18468 ) ( #18445 )
...
Calculate `total_tokens` in usage data in Response manually if:
- `total_tokens` is missing
- `total_tokens` can be calculated from input and output tokens
Run the test for this feature with:
`poetry run pytest tests/test_litellm/responses/test_responses_utils.py -k "test_transform_response_api_usage_calculates_total_from_input_and_output_tokens_if_available" -v`
2026-01-06 20:34:02 +05:30
Ishaan Jaff
69aa111fdd
[UI] - Feat add request provider form on UI ( #18704 )
...
* add request provider form
* fix link to github
* add button
* fix link
2026-01-06 18:54:57 +05:30
Sameer Kankute
ce0f71fbe9
Merge pull request #18706 from BerriAI/litellm_fix_reasoning_summary_default
...
[Bug] fix model map
2026-01-06 18:31:33 +05:30
Sameer Kankute
0cd92e895f
fix model map
2026-01-06 18:14:00 +05:30
Sameer Kankute
e3cbd5ff56
Merge pull request #18705 from BerriAI/litellm_fix_reasoning_summary_default
...
Add the LITELLM_REASONING_AUTO_SUMMARY in doc
2026-01-06 18:05:55 +05:30
Sameer Kankute
1c177a576b
Add the LITELLM_REASONING_AUTO_SUMMARY in doc
2026-01-06 18:04:09 +05:30
Sameer Kankute
353769d2ac
Merge pull request #18688 from BerriAI/litellm_fix_reasoning_summary_default
...
[Fix] Put automatic reasoning summary inclusion behind feat flag
2026-01-06 17:56:40 +05:30
Sameer Kankute
aca656f036
Merge pull request #18702 from BerriAI/litellm_fix_mapped_test_3
...
fix: remove display name
2026-01-06 16:35:24 +05:30
Sameer Kankute
ffc462465d
fix: remove display name
2026-01-06 16:31:07 +05:30
Ishaan Jaff
76eda472be
[Feat] New API Endpoint - Responses API (v1/responses/compact) ( #18697 )
...
* init transform_compact_response_api_request
* init acompact_responses
* init async_compact_response_api_handler in llm http handler
* init transform_compact_response_api_request for openai
* init acompact_responses
* fix acompact_responses
* add OAI Compact API
* docs responses API Compact
* code qa checks
* test_openai_compact_responses_api
* fix mypy linting
2026-01-06 16:24:04 +05:30
Sameer Kankute
2e668d1dfe
Merge pull request #18701 from BerriAI/revert-17330-add-model-metadata
...
Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries"
2026-01-06 15:30:19 +05:30
Sameer Kankute
2baec27657
Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries"
2026-01-06 15:29:42 +05:30
Xiaohan Fu
07fe9e8604
implement failopen option default to True on grayswan guardrail ( #18266 )
...
* implement failopen option default to True
* introduce a config to set the timeout limit (default to 30)
2026-01-06 15:17:05 +05:30
Sameer Kankute
eb0193a8a5
Merge pull request #18695 from BerriAI/litellm_fix_mapped_test_060126
...
Fix mapped test 060126
2026-01-06 15:05:19 +05:30
Sameer Kankute
84b24ad030
fix:mypy mcp management
2026-01-06 14:48:31 +05:30
Sameer Kankute
15a28c7fe2
fix:test_api_error_handling
2026-01-06 14:44:34 +05:30
Sameer Kankute
0d050dc0ea
fix:test_anthropic_beta_header
2026-01-06 14:28:30 +05:30
Sameer Kankute
8aff258a93
fix: test_databricks_embeddings[True]
2026-01-06 14:20:30 +05:30
Sameer Kankute
386ea1354a
fix: async def test_bedrock_apply_guardrail_blocked()
2026-01-06 14:15:06 +05:30
Sameer Kankute
9c795a2baa
fix: test_all_models_have_display_name
2026-01-06 14:09:43 +05:30
Sameer Kankute
a087df365e
fix: test_aaamodel_prices_and_context_window_json_is_valid
2026-01-06 14:04:09 +05:30
Sameer Kankute
865c7a2215
fix: test_update_ui_settings_allowlisted_value
2026-01-06 13:58:37 +05:30
Sameer Kankute
9d59d3eef6
fix: test_secret_manager_failure_does_not_block_email
2026-01-06 13:58:15 +05:30
Sameer Kankute
9f65f82c56
Fix: ImportError: qualifire package is required for QualifireGuardrail. Install it with: pip install qualifire
2026-01-06 13:52:26 +05:30
YutaSaito
facc4b0b79
Merge pull request #18693 from BerriAI/litellm_fix_main_test
...
fix main test
2026-01-06 17:17:33 +09:00
Yuta Saito
ca14160375
Revert "fix: model eol"
...
This reverts commit 5aa1665d79
2026-01-06 16:49:30 +09:00
Yuta Saito
23713d1811
fix: anthropic claude-3-opus-20240229 EOL
2026-01-06 16:06:21 +09:00
Yuta Saito
5aa1665d79
fix: model eol
2026-01-06 15:47:37 +09:00
YutaSaito
abb4df9dc7
Merge pull request #18687 from BerriAI/revert-18177-litellm_fix_redisvl_dependency
...
Revert "Add redisvl in requirements.txt"
2026-01-06 15:12:39 +09:00
Sameer Kankute
bb00a53786
Put reasoning summary behind feat flag
2026-01-06 11:36:20 +05:30
YutaSaito
1897a1f894
Revert "Add redisvl in requirements.txt"
2026-01-06 15:04:56 +09:00
Sameer Kankute
694e44551f
Merge pull request #17330 from nmgarza5/add-model-metadata
...
feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries
2026-01-06 10:56:49 +05:30
Sameer Kankute
0f55c2b216
Merge pull request #18513 from talesofai/feat/responses-api-hooks-parity
...
feat (proxy) : Responses API Support More Streaming Callback Hooks
2026-01-06 10:51:48 +05:30
Sameer Kankute
3c0248edb9
Merge pull request #18663 from BerriAI/litellm_staging_01_05_2026
...
Staging 01/05/2026
2026-01-06 10:46:04 +05:30
Sameer Kankute
4ebd9b266b
Merge pull request #18177 from BerriAI/litellm_fix_redisvl_dependency
...
Add redisvl in requirements.txt
2026-01-06 10:43:25 +05:30
0717376
12f02f6c54
feat: Add GigaChat provider support ( #18564 )
...
* feat: Add GigaChat provider support
Add native support for GigaChat API (Sber AI, Russia's leading LLM).
Supported features:
- Chat completions (sync/async)
- Streaming (sync/async)
- Function calling / Tools
- Structured output via JSON schema (emulated through function calls)
- Image input (base64 and URL)
- Embeddings
Closes #18515
* fix: resolve mypy type errors in GigaChat handler
- Fix _prepare_file_data return type (use 3-tuple for cleaner type flow)
- Add type annotations for lists in _process_content_parts methods
- Add type annotations in _collapse_user_messages
- Use ChatCompletionToolCallChunk for proper tool_use typing
- Add type: ignore[override] for astreaming async generator
* refactor(gigachat): migrate to BaseConfig pattern
* fix: remove unused imports
* fix: resolve mypy type errors
* fix: mypy type errors
* refactor: address review feedback for GigaChat provider
- Remove singleton pattern, reuse litellm HTTPHandler
- Move constants/errors to transformation files, delete common_utils.py
- Add models to model_prices_and_context_window.json
- Fix ssl_verify not passed to HTTP client for embeddings
* docs: update GigaChat documentation with ssl_verify requirement
2026-01-06 10:10:02 +05:30
YutaSaito
a774e7899c
Merge pull request #18281 from Eric84626/main
...
Fix: fixed some MCP gateway oauth2 auth issues and ClosedResourceError
2026-01-06 13:22:46 +09:00
yuneng-jiang
612782e2fb
Merge pull request #18680 from BerriAI/litellm_sso_modal_fix
...
[Fix] UI - SSO Edit Modal Clear Role Mapping Values on Provider Change
2026-01-05 19:55:49 -08:00
YutaSaito
31470032ad
Merge pull request #18681 from BerriAI/litellm_feat_mcp-server-visibility-configurable
...
[feat] mcp server visibility configurable
2026-01-06 12:53:07 +09:00
yuneng-jiang
1fb887aaab
E2E Test - Can View Admin Setting Page
2026-01-05 19:51:01 -08:00
YutaSaito
ccdcb20048
Merge pull request #18279 from mangabits/fix-otel-provider
...
Use already configured opentelemetry providers
2026-01-06 12:49:48 +09:00
mangabits
ce678403b3
Address review comments
2026-01-05 19:42:44 -08:00
LingXuanYin
d101990342
Clarify responses API streaming context
2026-01-06 10:54:19 +08:00
LingXuanYin
499fc9f48a
Align responses API streaming hooks with chat pipeline
2026-01-06 10:54:19 +08:00
Yuta Saito
29e658012a
docs: add user_mcp_management_mode
2026-01-06 11:43:58 +09:00
Yuta Saito
375f3ed439
fix: missing mcp_allow_all_ui.png
2026-01-06 11:23:22 +09:00
yuneng-jiang
4566255181
Fixing tests
2026-01-05 18:22:54 -08:00
