Open 4EPBEED opened 1 year ago
Why pygg infinity generation text? The text is't even related to what I wrote.
I'm aware of the issue. I've been looking into it.
Problem is, C++ isn't my forte so it'll take a while unless a more skilled person comes along and makes a PR.
Thanks for the answer. Still, your work is amazing. Hope everything works out for you!
I think I understand what the problem of infinite generation is. In the original, Pygmalion catches the "/nYou:" token and stops generation and passes the input to the user. It is necessary either to make changes in the dataset, or to enter a stop list of tokens.
I Agree with "/nYou:" token catching It'll be nice to have a one-time inference script too since I think using it through a Python wrapper will be easier just like Tesseract I'm looking forward to implementing this into my AIWaifu_Project Good work btw đź‘Ť
In some cases, I still managed to stop the infinite generation, but not often it didn’t work very well. Where |end of text| it stops there. Now I'm thinking about how to intercept the token to stop and pass the input to the user.
Why pygg infinity generation text? The text is't even related to what I wrote.