scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-09-12 23:01:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 182

Add truncate_prompt_tokens param for vllm embedding

Browse source 
vllm embedding should allow sending "truncate_prompt_tokens". Links to https://github.com/vllm-project/vllm/blob/main/vllm/entrypoints/pooling/embed/protocol.py#L66
This commit is contained in:
Michael Möbius 2026-04-04 09:19:51 +02:00 • committed by GitHub
parent a5322c6efc
commit c2e8da1e65
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
litellm/llms/hosted_vllm/embedding/transformation.py
View file

@ -150,6 +150,7 @@ class HostedVLLMEmbeddingConfig(BaseEmbeddingConfig):
"dimensions",
"encoding_format",
"user",
"truncate_prompt_tokens",
]
def map_openai_params(