search

machamp-nlp / machamp

Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/
Apache License 2.0
80 stars 21 forks source link

Decoder dropout #33

Closed Lguyogiro closed 11 months ago

Lguyogiro commented 12 months ago

This adds a decoder dropout option so that you can set different dropouts in the different task decoders if desired. The dropout is applied to the mlm embeddings as a first step in the decoder. The decoder dropouts default to zero.

robvanderg commented 12 months ago

Looks good!, would you mind to add a documentation page?, it could be in the list of "other things" in the main README?

Don't forget to acknowledge yourself at the bottom of the page