mirror of
https://github.com/BerriAI/litellm.git
synced 2026-11-02 07:13:02 +00:00
NVIDIA NIM serves logprobs and top_logprobs, but nvidia_nim refused both with UnsupportedParamsError. The Responses bridge also never asked chat for logprobs when include requested message.output_text.logprobs, leaked top_logprobs on its own, and dropped the logprobs the model returned. It now maps include to chat logprobs and puts the tokens on output_text and the streaming events |
||
|---|---|---|
| .. | ||
| docker-entrypoint.d | ||
| litellm-dashboard | ||
| Dockerfile | ||
| nginx.conf | ||