Closed leexinhao closed 3 months ago
Hi, thanks for your interest.
I think you should do some prompt engineering, like:
text_input = "In the context of a culinary event where someone 'puts the bread on the plate', determine the closest time from the following options:"\
"(A) 33.5 seconds; (B) 37.7 seconds; (C) 39.9 seconds; (D) 50.9 seconds; (E) 55.9 seconds."\
"Please select the correct option by responding with the corresponding letter (A)-(E). Avoid outputting anything other than the designated letters."
The output is:
The closest time is (B) 37.7 seconds.
@leexinhao Hi, we found that reduce lora_alpha
from 32 to 20 during inference can be very helpful for qa tasks. See https://github.com/RenShuhuai-Andy/TimeChat/blob/master/docs/FAQ.md#3-how-to-better-instruct-the-model-to-perform-qa-or-other-specialized-tasks
I find that the model seems to have a hard time output options, my prompt is: