search

minimaxir / textgenrnn

Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
Other
4.94k stars 756 forks source link

Regarding repeated words #226

Open jaytimbadia opened 3 years ago

jaytimbadia commented 3 years ago

Hey, Nice work!!

I just have one query. I am working on character-level text generation with data as novels.

In Novels, there are character names, which occur too many times, so will that affect my model while generating text?

Thanks in Advance!

noob10293 commented 2 years ago

if your input text has lots of one word, then your output will probably follow the same style. character names aren't used that often, either, Harry Potter has only 47 mentions of "Harry Potter".