Baselines and pretrained word embeddings

allenai / pnp

Probabilistic Neural Programming

Apache License 2.0

75 stars 22 forks source link

Baselines and pretrained word embeddings #55

Closed jayantk closed 7 years ago

jayantk commented 7 years ago

Implemented seq2seq and seq2tree baselines by reformatting logical forms and using a different type declaration. There are still some random crashing bugs here with executing ill-formed logical forms, but i'm working through them.

Also tried pre-trained word embeddings using GloVe. These didn't help -- in fact, they hurt by ~10 accuracy points -- but I'm not confident that it's being used properly.

matt-gardner commented 7 years ago

What are you not confident about with the word embeddings? The initializer?