xihajun
commented
11 months ago Ah, I found one from https://docs.mistral.ai/llm/mistral-instruct-v0.1
But it is for instruct model, any idea of how to do it via base model? Or would you recommand to finetune with instruct model?
It is really impressive when doing inference with Mistral 7B. Thank you so much for open source it.
May I kindly ask what kind of format is the best way to finetune the model?
I read some blog posts and found a few different formats
text_row = f"""<s>[INST] {instruction} here are the inputs {input} [/INST] \\n {output} </s>"""Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Response:\n{output}</s>I wonder if it is possible to have some suggestion from the team to see which is the best way to finetune?
Many thanks!