Mimic RACL like cross attention between tasks

pmhalvor / fgsa

Main repo for my Masters thesis on Fine Grained Sentiment Analysis

4 stars 0 forks source link

Closed pmhalvor closed 2 years ago

pmhalvor commented 2 years ago

[x] build RACL like architecture in PyTorch
- [x] L2 normalization
- [x] correct queries, keys, values into attention blocks
- [x] build each of the 4 relation types in forward
[x] check model is learning
[x] hyper parameter search
[x] comparable to TensorFlow-RACL (OG)?