Wiley Kestner
9e6714fe1b
Tally total_tokens in response if missing ( #18468 ) ( #18445 )
...
Calculate `total_tokens` in usage data in Response manually if:
- `total_tokens` is missing
- `total_tokens` can be calculated from input and output tokens
Run the test for this feature with:
`poetry run pytest tests/test_litellm/responses/test_responses_utils.py -k "test_transform_response_api_usage_calculates_total_from_input_and_output_tokens_if_available" -v`
2026-01-06 20:34:02 +05:30
Ishaan Jaff
69aa111fdd
[UI] - Feat add request provider form on UI ( #18704 )
...
* add request provider form
* fix link to github
* add button
* fix link
2026-01-06 18:54:57 +05:30
Sameer Kankute
ce0f71fbe9
Merge pull request #18706 from BerriAI/litellm_fix_reasoning_summary_default
...
[Bug] fix model map
2026-01-06 18:31:33 +05:30
Sameer Kankute
0cd92e895f
fix model map
2026-01-06 18:14:00 +05:30
Sameer Kankute
e3cbd5ff56
Merge pull request #18705 from BerriAI/litellm_fix_reasoning_summary_default
...
Add the LITELLM_REASONING_AUTO_SUMMARY in doc
2026-01-06 18:05:55 +05:30
Sameer Kankute
1c177a576b
Add the LITELLM_REASONING_AUTO_SUMMARY in doc
2026-01-06 18:04:09 +05:30
Sameer Kankute
353769d2ac
Merge pull request #18688 from BerriAI/litellm_fix_reasoning_summary_default
...
[Fix] Put automatic reasoning summary inclusion behind feat flag
2026-01-06 17:56:40 +05:30
Sameer Kankute
aca656f036
Merge pull request #18702 from BerriAI/litellm_fix_mapped_test_3
...
fix: remove display name
2026-01-06 16:35:24 +05:30
Sameer Kankute
ffc462465d
fix: remove display name
2026-01-06 16:31:07 +05:30
Ishaan Jaff
76eda472be
[Feat] New API Endpoint - Responses API (v1/responses/compact) ( #18697 )
...
* init transform_compact_response_api_request
* init acompact_responses
* init async_compact_response_api_handler in llm http handler
* init transform_compact_response_api_request for openai
* init acompact_responses
* fix acompact_responses
* add OAI Compact API
* docs responses API Compact
* code qa checks
* test_openai_compact_responses_api
* fix mypy linting
2026-01-06 16:24:04 +05:30
Sameer Kankute
2e668d1dfe
Merge pull request #18701 from BerriAI/revert-17330-add-model-metadata
...
Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries"
2026-01-06 15:30:19 +05:30
Sameer Kankute
2baec27657
Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries"
2026-01-06 15:29:42 +05:30
Sameer Kankute
eb0193a8a5
Merge pull request #18695 from BerriAI/litellm_fix_mapped_test_060126
...
Fix mapped test 060126
2026-01-06 15:05:19 +05:30
Sameer Kankute
84b24ad030
fix:mypy mcp management
2026-01-06 14:48:31 +05:30
Sameer Kankute
15a28c7fe2
fix:test_api_error_handling
2026-01-06 14:44:34 +05:30
Sameer Kankute
0d050dc0ea
fix:test_anthropic_beta_header
2026-01-06 14:28:30 +05:30
Sameer Kankute
8aff258a93
fix: test_databricks_embeddings[True]
2026-01-06 14:20:30 +05:30
Sameer Kankute
386ea1354a
fix: async def test_bedrock_apply_guardrail_blocked()
2026-01-06 14:15:06 +05:30
Sameer Kankute
9c795a2baa
fix: test_all_models_have_display_name
2026-01-06 14:09:43 +05:30
Sameer Kankute
a087df365e
fix: test_aaamodel_prices_and_context_window_json_is_valid
2026-01-06 14:04:09 +05:30
Sameer Kankute
865c7a2215
fix: test_update_ui_settings_allowlisted_value
2026-01-06 13:58:37 +05:30
Sameer Kankute
9d59d3eef6
fix: test_secret_manager_failure_does_not_block_email
2026-01-06 13:58:15 +05:30
Sameer Kankute
9f65f82c56
Fix: ImportError: qualifire package is required for QualifireGuardrail. Install it with: pip install qualifire
2026-01-06 13:52:26 +05:30
YutaSaito
facc4b0b79
Merge pull request #18693 from BerriAI/litellm_fix_main_test
...
fix main test
2026-01-06 17:17:33 +09:00
Yuta Saito
ca14160375
Revert "fix: model eol"
...
This reverts commit 5aa1665d79
2026-01-06 16:49:30 +09:00
Yuta Saito
23713d1811
fix: anthropic claude-3-opus-20240229 EOL
2026-01-06 16:06:21 +09:00
Yuta Saito
5aa1665d79
fix: model eol
2026-01-06 15:47:37 +09:00
YutaSaito
abb4df9dc7
Merge pull request #18687 from BerriAI/revert-18177-litellm_fix_redisvl_dependency
...
Revert "Add redisvl in requirements.txt"
2026-01-06 15:12:39 +09:00
Sameer Kankute
bb00a53786
Put reasoning summary behind feat flag
2026-01-06 11:36:20 +05:30
YutaSaito
1897a1f894
Revert "Add redisvl in requirements.txt"
2026-01-06 15:04:56 +09:00
Sameer Kankute
694e44551f
Merge pull request #17330 from nmgarza5/add-model-metadata
...
feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries
2026-01-06 10:56:49 +05:30
Sameer Kankute
0f55c2b216
Merge pull request #18513 from talesofai/feat/responses-api-hooks-parity
...
feat (proxy) : Responses API Support More Streaming Callback Hooks
2026-01-06 10:51:48 +05:30
Sameer Kankute
3c0248edb9
Merge pull request #18663 from BerriAI/litellm_staging_01_05_2026
...
Staging 01/05/2026
2026-01-06 10:46:04 +05:30
Sameer Kankute
4ebd9b266b
Merge pull request #18177 from BerriAI/litellm_fix_redisvl_dependency
...
Add redisvl in requirements.txt
2026-01-06 10:43:25 +05:30
0717376
12f02f6c54
feat: Add GigaChat provider support ( #18564 )
...
* feat: Add GigaChat provider support
Add native support for GigaChat API (Sber AI, Russia's leading LLM).
Supported features:
- Chat completions (sync/async)
- Streaming (sync/async)
- Function calling / Tools
- Structured output via JSON schema (emulated through function calls)
- Image input (base64 and URL)
- Embeddings
Closes #18515
* fix: resolve mypy type errors in GigaChat handler
- Fix _prepare_file_data return type (use 3-tuple for cleaner type flow)
- Add type annotations for lists in _process_content_parts methods
- Add type annotations in _collapse_user_messages
- Use ChatCompletionToolCallChunk for proper tool_use typing
- Add type: ignore[override] for astreaming async generator
* refactor(gigachat): migrate to BaseConfig pattern
* fix: remove unused imports
* fix: resolve mypy type errors
* fix: mypy type errors
* refactor: address review feedback for GigaChat provider
- Remove singleton pattern, reuse litellm HTTPHandler
- Move constants/errors to transformation files, delete common_utils.py
- Add models to model_prices_and_context_window.json
- Fix ssl_verify not passed to HTTP client for embeddings
* docs: update GigaChat documentation with ssl_verify requirement
2026-01-06 10:10:02 +05:30
YutaSaito
a774e7899c
Merge pull request #18281 from Eric84626/main
...
Fix: fixed some MCP gateway oauth2 auth issues and ClosedResourceError
2026-01-06 13:22:46 +09:00
yuneng-jiang
612782e2fb
Merge pull request #18680 from BerriAI/litellm_sso_modal_fix
...
[Fix] UI - SSO Edit Modal Clear Role Mapping Values on Provider Change
2026-01-05 19:55:49 -08:00
YutaSaito
31470032ad
Merge pull request #18681 from BerriAI/litellm_feat_mcp-server-visibility-configurable
...
[feat] mcp server visibility configurable
2026-01-06 12:53:07 +09:00
yuneng-jiang
1fb887aaab
E2E Test - Can View Admin Setting Page
2026-01-05 19:51:01 -08:00
YutaSaito
ccdcb20048
Merge pull request #18279 from mangabits/fix-otel-provider
...
Use already configured opentelemetry providers
2026-01-06 12:49:48 +09:00
mangabits
ce678403b3
Address review comments
2026-01-05 19:42:44 -08:00
LingXuanYin
d101990342
Clarify responses API streaming context
2026-01-06 10:54:19 +08:00
LingXuanYin
499fc9f48a
Align responses API streaming hooks with chat pipeline
2026-01-06 10:54:19 +08:00
Yuta Saito
29e658012a
docs: add user_mcp_management_mode
2026-01-06 11:43:58 +09:00
Yuta Saito
375f3ed439
fix: missing mcp_allow_all_ui.png
2026-01-06 11:23:22 +09:00
yuneng-jiang
4566255181
Fixing tests
2026-01-05 18:22:54 -08:00
Yuta Saito
694bcb6186
feat: add user_mcp_management_mode for view_all visibility
2026-01-06 11:22:28 +09:00
yuneng-jiang
2d464032c5
Fixing Edit SSO Settings Modal
2026-01-05 18:08:41 -08:00
yuneng-jiang
4cdcdc98e8
Merge pull request #18677 from BerriAI/litellm_ui_sso_settings_role
...
[Feature] UI - SSO Settings Page Add Role Mappings
2026-01-05 17:40:29 -08:00
yuneng-jiang
8851b86d93
Adding Role Mappings
2026-01-05 17:30:31 -08:00
