Closed duyluandethuong closed 3 weeks ago
Try this: BOS = false, EOS = false
[system](<|im_start|>system
You are a helpful assistant.)
<eos><|im_start|>user
{prompt}<eos><|im_start|>assistant
stop words = <|im_start|>,<eos>
Tell me this template helped you?
I'm trying to use this model: https://huggingface.co/SeaLLMs/SeaLLM-7B-v2.5-GGUF
The SeaLLM-7B-v2.5 has the following preset for LM studio: https://huggingface.co/SeaLLMs/SeaLLM-7B-v2.5-GGUF/blob/main/seallm-v2.5.preset.json
I don't know how to convert this into prompt format for LLMFarm. Please help.
When I try to run in Xcode, in print the following lines