Implemented missing tricks for BiaffineParser, now PTB UAS 95.55, LAS 94.48

elitcloud / elit

🔠 Evolution of Language and Information Technology

https://elit.cloud

Other

47 stars 7 forks source link

Implemented missing tricks for BiaffineParser, now PTB UAS 95.55, LAS 94.48 #19

Closed hankcs closed 6 years ago

hankcs commented 6 years ago

Fixes #

Some tricks helping model generalize better.

Proposed Changes

[x] Word dropout
[x] Dropout across time-steps in RNN cell
[x] Orthonormal initialization of RNN weights

imgarylai commented 6 years ago

Thanks for this pull request. Sorry for replying you late because of my busy works.
I wIll review this as soon as possible. Best

imgarylai commented 6 years ago

Hello @hankcs I'm sorry for not coming back in a while. Due to our core API changes a lot, we might not be able to integrate your pull request in this stage really quick. Let's talk about this when we meet! I'm much appreciate your works.
Thank you

hankcs commented 6 years ago

Hi Gary, that's fine. I'm working on the Gluon/MXNet porting of this parser, under Prof. Choi's instruction. Let's discuss it on campus later.