mirror of
https://github.com/open-webui/open-webui.git
synced 2026-10-07 02:58:21 +00:00
fix: tool calls get mixed up between rounds when the model reuses tool call ids (#31887)
Some providers, like Kimi K3 on OpenRouter, number their tool calls from zero again each time the model calls tools within the same reply. A later batch of calls then overwrote the earlier calls with the same id, so the saved chat showed the earlier calls with the later arguments, and the model was sent its earlier results next to the wrong arguments. A new tool call whose id is already used in the same reply now gets a fresh id, so every call keeps its own arguments and result, and providers that send unique ids are untouched. Tested before and after against a mock provider that reuses ids on every round. Fixes #28305
This commit is contained in:
parent
53f47b3dc7
commit
88720c6928
1 changed files with 7 additions and 0 deletions
|
|
@ -5202,6 +5202,13 @@ async def streaming_chat_response_handler(response, ctx):
|
|||
if delta_tool_call['function'].get('name') is None:
|
||||
delta_tool_call['function']['name'] = ''
|
||||
delta_tool_call['id'] = delta_tool_call.get('id') or output_id('fc')
|
||||
# Some providers restart tool call ids on every round
|
||||
if any(
|
||||
item.get('type') == 'function_call'
|
||||
and item.get('call_id') == delta_tool_call['id']
|
||||
for item in full_output()
|
||||
):
|
||||
delta_tool_call['id'] = output_id('fc')
|
||||
delta_arguments = delta_tool_call['function'].get('arguments')
|
||||
if not isinstance(delta_arguments, str):
|
||||
delta_tool_call['function']['arguments'] = (
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue