mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-03 07:23:33 +00:00
a713ed6bab
* test(e2e): add gemini tool call id length repro for LIT-8912 Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> * fix(gemini): add thought_signature_in_tool_call_id to keep tool call ids short for clients that cap them * fix(gemini): pair a tool result with its call when the client re-adds the thought signature to the call id Strands, which the AgentCore harness runs, puts provider_specific_fields.thought_signature back on the assistant tool call id as <id>__thought__<signature> while its tool result keeps the bare id, so the Gemini conversion found no matching call and answered 500. Ids now match with the signature suffix stripped. Also adds thought_signature_in_tool_call_id to the litellm_params inventory test and gives the pass-through tests' mocked logging objects the litellm_params a real Logging object always has. * fix(gemini): keep the thought signature on streamed Messages and Responses tool calls and accept a string setting * fix(gemini): read the thought signature back from Responses input and coerce the per-request setting A Responses function_call input item now keeps its provider_specific_fields, so a client that sends the item back gets its real thought signature replayed to Gemini. A per-request thought_signature_in_tool_call_id of "false" or 0 now keeps ids short, and a value that is not a boolean answers 400, or is dropped under drop_params, instead of a 500. The e2e test now uses the sdk fixture and @meta subjects * fix(caching): key the response cache on thought_signature_in_tool_call_id * fix(responses): send thought signature fields only with short ids and drop malformed routing kwargs whole * fix(main): validate routing kwargs after the locals snapshot so fallbacks and model_list calls keep working The e2e test now uses gemini-3.8-flash with enough max_tokens to finish thinking before the tool call. * fix(gemini): keep non-chat routes tolerant of a malformed thought_signature_in_tool_call_id, match tool results by exact id first, and keep the deployment's value when drop_params drops a malformed override * fix(router): validate strict litellm params through a helper so star imports cannot re-bind a public Final * perf(router): skip strict validation when a request overrides no deployment param * fix(responses): keep a dict tool call's thought signature on the streamed function_call done item * refactor(main): return invalid supplemental params as a value and test the streaming tool call with a real response --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| agent_engine | ||
| audio_transcription | ||
| batches | ||
| context_caching | ||
| count_tokens | ||
| files | ||
| fine_tuning | ||
| fixtures | ||
| gemini | ||
| gemini_embeddings | ||
| image_edit | ||
| image_generation | ||
| interactions | ||
| multimodal_embeddings | ||
| rag_engine | ||
| realtime | ||
| rerank | ||
| text_to_speech | ||
| vertex_ai_partner_models | ||
| vertex_embeddings | ||
| vertex_gemma_models | ||
| videos | ||
| __init__.py | ||
| google_genai_proxy_test_config.yaml | ||
| test_bge_embedding.py | ||
| test_bge_response_transformation.py | ||
| test_common_utils.py | ||
| test_gemini_batch_embeddings.py | ||
| test_gemini_empty_properties.py | ||
| test_gemini_header_forwarding.py | ||
| test_http_status_201.py | ||
| test_vertex.py | ||
| test_vertex_ai_batch_transformation.py | ||
| test_vertex_ai_common_utils.py | ||
| test_vertex_ai_non_gemini.py | ||
| test_vertex_ai_psc_endpoint_support.py | ||
| test_vertex_ai_search_vector_store_transformation.py | ||
| test_vertex_gemini_gcs_uri_mime.py | ||
| test_vertex_global_url_support.py | ||
| test_vertex_image_generation.py | ||
| test_vertex_llm_base.py | ||
| test_vertex_model_garden_openapi.py | ||
| test_vertex_passthrough_logging_handler.py | ||