Use of Transformers/Attention

sigsep / open-unmix-pytorch

Open-Unmix - Music Source Separation for PyTorch

https://sigsep.github.io/open-unmix/

MIT License

1.24k stars 181 forks source link

Use of Transformers/Attention #122

Closed ayush055 closed 5 months ago

ayush055 commented 2 years ago

Hi, I was just wondering if there have been any attempts at using a Transformer instead of the Bi-LSTM or utilizing attention in the network to potentially improve results?