Closed Ynjxsjmh closed 2 years ago
Hi, thanks for your interest. First, the DECASE model is based on a CNN-Transformer architecture, not a full transformer model like ACT. Second, they are evaluated on different datasets. ACT is evaluated on AudioCaps and DECASE model is evaluated on Clotho.
Thanks for your reply, I can well understand now. Some DECASE models are pretrained on AudioCaps and all are evaluated on Clotho.
Hi,
In my opinion, model structure in this repo is the same with your ACT model, they both use a full Transformer network based on an encoder-decoder architecture.
This paper further uses transfer learning and reinforcement learning to fine tune the parameters, but why the result in this paper is worse than the ACT?
Take following two models as an example: