search

Tencent / NeuralNLP-NeuralClassifier

An Open-source Neural Hierarchical Multi-label Text Classification Toolkit
Other
1.83k stars 402 forks source link

[Enhancement] Add a mask for Multihead Attention #3

Closed vanewu closed 5 years ago

vanewu commented 5 years ago

It might be more reasonable to add a mask for various attention.

eg. Multihead Attention https://github.com/Tencent/NeuralNLP-NeuralClassifier/blob/master/model/layers.py#L132

liqunhit commented 5 years ago

Thanks for your good advice, we will consider adding it later.