Krrish Dholakia
2fd2310b8e
refactor: update Delta
2025-09-01 18:13:31 -07:00
Krrish Dholakia
0fbcc01173
feat(types/utils.py): support 'images' field in output
...
Compatible with Openrouter response format
Closes https://github.com/BerriAI/litellm/pull/14151
2025-09-01 18:05:16 -07:00
Ishaan Jaff
e17bed715e
DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 17:08:03 -07:00
Ishaan Jaff
4c7b3e10ed
[Bug Fix] Gemini Tool Calling - fix gemini empty enum property ( #14155 )
...
* fix: _convert_schema_types
* fix recursive detector
* test_convert_schema_types_type_array_conversion
* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
* add _fix_enum_empty_strings
* test_tool_call_with_empty_enum_property
* test_fix_enum_empty_strings
* fix _fix_enum_empty_strings
2025-09-01 17:05:01 -07:00
Ishaan Jaff
7656cb3d6e
test fix
2025-09-01 17:04:47 -07:00
Ishaan Jaff
2331fb45d5
[Bug]: Gemini 2.5 Pro – schema validation fails with OpenAI-style type arrays in tools ( #14154 )
...
* fix: _convert_schema_types
* fix recursive detector
* test_convert_schema_types_type_array_conversion
* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 16:53:20 -07:00
Ishaan Jaff
98d57b5d27
[Feat] Allow using x-litellm-stream-timeout header for stream timeout in requests ( #14147 )
...
* fix: allow passing stream_timeout header
* fix: _get_stream_timeout_from_request
* test_add_litellm_data_to_request_with_stream_timeout_header
* docs: LiteLLM Headers
* test_add_litellm_data_to_request_with_stream_timeout_header
2025-09-01 15:59:14 -07:00
Mubashir Osmani
58ac3ecf84
openrouter: added gpt 4.1 model family ( #14101 )
2025-09-01 15:36:17 -07:00
Ishaan Jaff
58b713d19d
[Bug fix] Misclassified 500 error on invalid image_url in /chat/completions request ( #14149 )
...
* add ImageFetchError
* docs ImageFetchError
* fix ImageFetchError
* test_completion_with_invalid_image_url
2025-09-01 15:26:27 -07:00
Ishaan Jaff
2985915357
[Perf] LiteLLM Proxy: +400 RPS when using correct amount of CPU cores ( #14153 )
...
* bump: DEFAULT_NUM_WORKERS_LITELLM_PROXY
* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
2025-09-01 15:26:16 -07:00
Krish Dholakia
9e947fce19
Merge pull request #14087 from zainhas/main
...
update together models
2025-09-01 15:07:58 -07:00
Abhinav
b6c26c3365
helm(chart): add optional PodDisruptionBudget for litellm proxy ( #14062 ) ( #14093 )
2025-09-01 12:21:44 -07:00
Krish Dholakia
a6f8808b0b
Merge pull request #14134 from BerriAI/back-to-logs
...
Back to Keys should say Back to Logs
2025-09-01 12:01:47 -07:00
Sameer Kankute
c51665ec9c
fix xai cost calculation ( #14127 )
2025-09-01 11:31:56 -07:00
tanjiro
735af5bf36
success tooltip added ( #14132 )
2025-09-01 11:08:58 -07:00
tanjiro
ca70b689af
Logs page screen size fixed ( #14135 )
...
* width fixed
* tailwind css instead of inline css
* minor width fixes
* time button fixed
* fixed width for the "showing..." part
2025-09-01 11:08:09 -07:00
Krrish Dholakia
0c9051abba
docs(docker_quick_start.md): add docker compose to quick start
2025-08-31 21:24:30 -07:00
tanjiro
15baaf68db
back to logs added conditionally
2025-08-31 17:09:11 +09:00
Ishaan Jaff
dea3b53578
UI new build
2025-08-30 17:13:48 -07:00
Ishaan Jaff
ccb7ce03a3
[Docs] v1.76.1-stable ( #14094 )
...
* docs 1.76.1
* fix docs
* docs 1.76.1
* New Model Support
* docs fixes
2025-08-30 14:54:27 -07:00
Ishaan Jaff
34275ab273
Revert "Merge pull request #14005 from moshemorad/bedrock_fix_structure_output"
...
This reverts commit 75c327cb9e , reversing
changes made to afa687182a .
2025-08-30 13:37:10 -07:00
Ishaan Jaff
48d3aad68f
test_caching_with_models_v2
2025-08-30 13:21:14 -07:00
Ishaan Jaff
c9b86775a7
test_system_message_with_no_user_message
2025-08-30 13:09:25 -07:00
Ishaan Jaff
7ff93cd1b1
Revert "Merge pull request #12865 from aholmberg/holmberg/default-reasoning"
...
This reverts commit 68f4847659 , reversing
changes made to df39320889 .
2025-08-30 13:07:33 -07:00
Ishaan Jaff
3cb8e23dfe
Revert "Merge pull request #14026 from TomeHirata/citation-supported-text"
...
This reverts commit afa687182a , reversing
changes made to 55186dad4c .
2025-08-30 11:23:18 -07:00
Ishaan Jaff
dc6161535a
fix for supports_reasoning check added in 68f4847659
2025-08-30 11:06:02 -07:00
Ishaan Jaff
de6b08e76e
test_supports_tool_choice
2025-08-30 10:35:16 -07:00
Ishaan Jaff
3fc2198d27
fix: test_gemini_image_generation_async_stream
2025-08-30 10:33:23 -07:00
Ishaan Jaff
efebf7ec7b
test_gemini_image_generation_async
2025-08-30 10:29:24 -07:00
Ishaan Jaff
fa4c833e58
fix: supports reasoning
2025-08-30 10:29:08 -07:00
Ishaan Jaff
fd39f22e3e
test_completion_openrouter_reasoning_content
2025-08-30 09:27:37 -07:00
superpoussin22
7ed4a84393
Fix indentation in get_llm_provider_logic.py ( #14088 )
...
* Fix indentation in get_llm_provider_logic.py
fix missing closing )
* Fix indentation in get_llm_provider_logic.py
fix typo
2025-08-30 09:24:41 -07:00
Krish Dholakia
4d0c1a1769
Merge pull request #13144 from joshualipman123/add-vercel-ai-gateway-provider
...
Add Vercel AI Gateway provider
2025-08-29 22:27:20 -07:00
Krish Dholakia
8b11452d9e
Merge branch 'main' into add-vercel-ai-gateway-provider
2025-08-29 22:27:08 -07:00
Krish Dholakia
ead7e7259b
Merge pull request #13152 from betterthanbreakfast/bug-openmeter-user-id-from-token
...
[Bug]: Set user from token user_id for OpenMeter integration
2025-08-29 22:21:26 -07:00
Krish Dholakia
85640e57cd
Merge pull request #14075 from BerriAI/fix-collapsible-nav
...
Fix collapsible navbar design
2025-08-29 22:16:25 -07:00
Krish Dholakia
75c327cb9e
Merge pull request #14005 from moshemorad/bedrock_fix_structure_output
...
Bedrock fix structure output
2025-08-29 22:04:51 -07:00
Krish Dholakia
afa687182a
Merge pull request #14026 from TomeHirata/citation-supported-text
...
Add supported text field to anthropic citation response
2025-08-29 22:02:18 -07:00
Krrish Dholakia
55186dad4c
fix: fix linting error
2025-08-29 21:53:37 -07:00
Zain Hasan
8a5df2eb74
update together models
...
- add tool choice for models
- add deepseek v3.1
2025-08-30 00:44:42 -04:00
Ishaan Jaff
562790cb31
fix: /v1/realtime check
2025-08-29 18:38:14 -07:00
Ishaan Jaff
37d885e46a
[Fix] LiteLLM does not support new web_search tool (Responses API) ( #14083 )
...
* test_basic_openai_responses_with_websearch
* fix: ResponsesAPIResponse
* fix: StandardBuiltInToolCostTracking
2025-08-29 18:33:52 -07:00
Ishaan Jaff
d9ca0f9300
security: fix next js version ( #14084 )
2025-08-29 18:09:11 -07:00
Ishaan Jaff
be86861eb8
feat: add gpt-realtime models - gpt-realtime ( #14082 )
...
* feat: add gpt-realtime models
* add input_cost_per_image
2025-08-29 17:49:47 -07:00
WilsonSunBritten
6d81d75948
docs: Add documentation for MAX_STRING_LENGTH_PROMPT_IN_DB environment variable ( #14079 )
...
Added documentation for the new MAX_STRING_LENGTH_PROMPT_IN_DB environment variable to the config settings guide. This variable controls the maximum length of strings in spend logs when sanitizing request bodies, with a default value of 1000 characters.
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-29 17:38:50 -07:00
Ishaan Jaff
5ee7a675f2
[Bug]: grok-4 does not support frequency_penalty, litellm should drop this param for grok-4 ( #14078 )
...
* fix: _supports_frequency_penalty
* _supports_frequency_penalty
* test_xai_grok_4_frequency_penalty_not_supported
2025-08-29 17:31:48 -07:00
Mubashir Osmani
38df2500b6
docs: usaged-based routing perf warnings ( #14080 )
2025-08-29 17:31:12 -07:00
Krrish Dholakia
86c5de17bc
fix(handle_jwt.py): document the raw received jwt token
2025-08-29 14:53:07 -07:00
Ishaan Jaff
607f425cc6
[Bug]: Fix Can't set reasoning_effort for DeepSeek-V3.1 on DeepInfra by default ( #14053 )
...
* fix DeepInfraConfig
* track supports reasoning
* fix: get_supported_openai_params
* test_deepseek_supported_openai_params
2025-08-29 13:15:43 -07:00
Carson Gee
e74f1b6b62
Added DataRobot provider to sidebar ( #14074 )
2025-08-29 13:15:33 -07:00