mirror of
https://github.com/BerriAI/litellm.git
synced 2026-09-10 22:41:41 +00:00
2a5d09ee87
The suggester pins temperature=0.2 for tool-selection determinism and passed no drop_params, so an operator-supplied reasoning model whose only accepted temperature is 1 made litellm raise UnsupportedParamsError and the whole suggestion fail. The default gpt-4o-mini is unaffected; the failure needs the caller to name a model. Every other internal LLM call the proxy makes on a user's behalf already opts in through judge_acompletion, which sets drop_params=True on both dispatch paths. This was the one caller outside that contract, so the sampling preference is now advisory here too and the call degrades instead of dying. Resolves LIT-6352 |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_ai_policy_suggester.py | ||
| test_endpoints.py | ||