Which prompt format we use for PhoGPT without instruct model!

VinAIResearch / PhoGPT

PhoGPT: Generative Pre-training for Vietnamese (2023)

Apache License 2.0

739 stars 67 forks source link

Closed lamkhatinh closed 10 months ago

lamkhatinh commented 10 months ago

I run this code without instruct model, but the code may be adapt with instruct only. Could you provide PROMPT format for model without instruct?

datquocnguyen commented 10 months ago

The base pre-trained model does not follow instructions: PROMPT = "{input_text}". You would have to fine-tune the base model to follow instructions.

ductuan-nguyen commented 9 months ago

Btw, could you provide the prompt format for context-based question answering?

datquocnguyen commented 9 months ago

@ductuan-nguyen PROMPT = "### Câu hỏi:\nDựa vào văn bản sau đây:\n{Insert_context_here}\nHãy trả lời câu hỏi: {Insert_question_here}\n\n### Trả lời:"