search

tloen / alpaca-lora

Instruct-tune LLaMA on consumer hardware
Apache License 2.0
18.66k stars 2.22k forks source link

Please update the template for Llama-2 chat completion #587

Open binhmed2lab opened 1 year ago

binhmed2lab commented 1 year ago

{ "description": "Template used by Llama-2-chat.", "prompt_input": "[INST] <>\n{instruction}\n<>\n\n{input} [/INST]", "prompt_no_input": "[INST] <>\n{instruction}\n<>\n\n[/INST]", "response_split": "[/INST]"
}

Code from https://github.com/facebookresearch/llama/blob/main/llama/generation.py#L283

LeonChengg commented 1 year ago

Is it should be in this format? image According to the https://huggingface.co/blog/llama2?source=post_page-----6cbb2c2ec4fd--------------------------------#how-to-prompt-llama-2