add multihead attention to main CatStack

source-data / py-smtag

PyTorch version of the SourceData SmartTag engine

Other

0 stars 1 forks source link

Open source-data opened 5 years ago

source-data commented 5 years ago

Not sure it bring anything. Testing with article/determinant embeddings:

source-data commented 5 years ago

no difference if attention turned off: