scriptoriumadmin/litellm
1
0
Fork 0
mirror of https://github.com/BerriAI/litellm.git synced 2026-10-08 03:08:45 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 115

only use tgai's prompt template for llama2 instruct models

Browse source
This commit is contained in:
Krrish Dholakia 2023-09-05 12:25:52 -07:00
parent 8845938b31
commit af33a85043
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
litellm/llms/prompt_templates/factory.py
View file

@ -111,7 +111,7 @@ def prompt_factory(model: str, messages: list):
return wizardcoder_pt(messages=messages)
elif "phind/phind-codellama" in model:
return phind_codellama_pt(messages=messages)
elif "togethercomputer/llama-2" in model:
elif "togethercomputer/llama-2" in model and "instruct" in model:
return togetherai_llama_2_chat_pt(messages=messages)
else:
return default_pt(messages=messages)