Open dimeldo opened 5 years ago
I have the same problem, did you solve it?
I think num_candidates=1 won't work without significant code modification (removing multiple choice head). I think I've said something different in a different thread, which was wrong.
@sshleifer It seems like the problem is not the num_candidates=1. The model sees a binary classification task when there is only one candidate in the utterance sample.
@sshleifer Do you have a workaround if I don't have multiple candidates for my dataset?
It would require significant code modification. I'd start by
there will probably be more bugs after that!
@sshleifer Yeah, probably not worth changing the code that much. I was talking about a hack, like having the multiple-choice candidates be some random string, say "Something.". Would that work?
Sounds like it might to me. Try it!
When setting args.num_candidates to 1, and the actual length of the candidates list of each entry is 1, I get this error during validation: