Open sidharthiimc opened 1 year ago
It is either prompt or instruction. You would feed in prompt when the model in hand is not finetuned with an instruction dataset. On the other hand, you will feed in an instruction when one uses an instruction-finetuned model.
I understand the prompt and instruction can't be passed together. Let's say I want to use one data point Alpaca dataset for inference after fine tuning. For example :
{ "instruction": "Identify the odd one out.", "input": "Twitter, Instagram, Telegram", "output": "Telegram" }
How can I pass this instruction + input in the generate.py?
I need an argument for "input" here -
or do you have any other solution for it? How can I structure it in prompt?