I have been encountered this problem, while testing with the pre-trained model, and the model that I trained with my own dataset. When the sentences contain 2 or more words, it will work correctly most of the time. However, when the sentence is 1 word, like "Hello!", "Hi", it will generate unintelligible result.
Here are some plots of sentence "Hello!"
Some Background:
I used my own dataset to train the model, based on the pre-trained model published from this repo.
has been trained 101k
Train loss 14000 0.146386, Grad Norm 0.442730, Validation loss 14000: 0.105691
Hi,
I have been encountered this problem, while testing with the pre-trained model, and the model that I trained with my own dataset. When the sentences contain 2 or more words, it will work correctly most of the time. However, when the sentence is 1 word, like "Hello!", "Hi", it will generate unintelligible result.
Here are some plots of sentence "Hello!"
Some Background:
` ################################
Experiment Parameters