search

clay-lab / transductions

A PyTorch framework for creating, running, and reproducing experiments on seq2seq models.
6 stars 3 forks source link

Make the decoders do something #29

Closed jopetty closed 3 years ago

jopetty commented 3 years ago

Right now, the decoders aren't actually doing anything except passing the encoded data through embedding, dropout, and linear output layers. We need to actually use the recurrent unit, which might (definitely does?) mean implementing the forward_step() method from the old version.

jopetty commented 3 years ago

Kinda fixed. The decoders do now do something. There's still a persistent issue where they aren't learning correctly, but this is a separate problem.