search

minimaxir / aitextgen

A robust Python tool for text-based AI training and generation using GPT-2.
https://docs.aitextgen.io
MIT License
1.84k stars 220 forks source link

I always get short chunks of text #171

Open Astraport opened 2 years ago

Astraport commented 2 years ago

When generating, I always get short chunks of text. 50 to 100 characters. I have tried min_length=200 but the generation process becomes infinite. What do you advise? Thank you.

pickles976 commented 2 years ago

I also have this issue

breadbrowser commented 2 years ago

same

breadbrowser commented 2 years ago

whats the max_length and n_embd you trained it with. because the max_length you trained it with is the max max_length for the generation

breadbrowser commented 2 years ago

or just set batch size to 50