Open Ricardokevins opened 9 months ago
In wizard math 7b, i use the model.generate to inference, but model will generate a lot of And to my surprise, it's not the special token.
How to prevent this when using model.generate? ( generating a lot of waste a lot of time)
In wizard math 7b, i use the model.generate to inference, but model will generate a lot of And to my surprise, it's not the special token.
How to prevent this when using model.generate? ( generating a lot of waste a lot of time)