scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-12 23:01:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 88

fix: coerce server_tool_use dict to ServerToolUse in stream_chunk_builder

Browse source 
When streaming Anthropic responses with web_search_options, stream_chunk_builder
reconstructs usage.server_tool_use as a dict rather than a ServerToolUse pydantic
object. This causes AttributeError when completion_cost() accesses
.web_search_requests on the dict.

Apply the same dict-to-object coercion pattern already used for prompt_tokens_details.

Fixes #26153
This commit is contained in:
Tai An 2026-04-21 06:13:45 -07:00
parent 26fcbc93e5
commit c7522a29d1
1 changed files with 4 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
litellm/litellm_core_utils/streaming_chunk_builder_utils.py
View file

@ -587,7 +587,10 @@ class ChunkProcessor:
hasattr(usage_chunk, "server_tool_use")
and usage_chunk.server_tool_use is not None
):
server_tool_use = usage_chunk.server_tool_use
_stu = usage_chunk.server_tool_use
server_tool_use = (
ServerToolUse(**_stu) if isinstance(_stu, dict) else _stu
)
if (
usage_chunk_dict["prompt_tokens_details"] is not None
and getattr(