search

srush / annotated-s4

Implementation of https://srush.github.io/annotated-s4
https://srush.github.io/annotated-s4
MIT License
468 stars 60 forks source link

RNN Sampling Code #11

Closed srush closed 2 years ago

srush commented 2 years ago

Sampling code currently works for MNist. However it uses the CNN version which is really slow. We should have a way to turn any of our sequence models into an RNN model.

Also my way of generating images is to average the predictions, which is a bit blurry. Maybe there is a better way?

siddk commented 2 years ago

Albert/Karan mentioned severe stability issues when turning the convolution into a recurrence to use for sampling (when applied to audio, longer sequence lengths... they didn't try sampling on MNIST or CIFAR).

Worth keeping in mind...

siddk commented 2 years ago

Closed by #43