martin-gorner / tensorflow-rnn-shakespeare

Code from the "Tensorflow and deep learning - without a PhD, Part 2" session on Recurrent Neural Networks.
Apache License 2.0
534 stars 249 forks source link

What the part 2 is doing? AI to write like Shakespeare? #17

Closed hcchengithub closed 7 years ago

hcchengithub commented 7 years ago

I can easily understand part 1, which is to recognize MNIST handwirtten digits all the way up to 99.51% accuracy. I enjoy experimenting all the tips, learning rate, dropout, up to BN. But can't see what is this part 2 doing at all. I appreciate anyone who point it out a little.

martin-gorner commented 7 years ago

@hcchengithub this model is a "language model". It predicts probabilities for the next character with a distribution similar to what you would find in the Shakespeare corpus. In itself, it is just for fun. Or you could call it an academic interest. But more useful models can be extrapolated from language models, like translation models or models that generate image captions. I explore some of them in this video: https://youtu.be/pzOzmxCR37I