Open JackKelly opened 3 years ago
Nice! How well does the new model perform?! :)
I dont have a direct comparision to running it without the cnn.
Cool beans. No rush, but it might be nice to have a direct comparison, so we can get a feel for whether it's useful to place a CNN before the attention. What do you think?
yea, I think it would be a useful to do. Could also see if 01, ... N layers of CNN are useful?
sounds great!
related: #35
3D cnn: sees two timesteps at once