Open Stefan-084 opened 4 months ago
What is the motivation for adding group normalization in the SeFB module, and what is the purpose of this operation? I did not find any relevant explanations in the article.
Hello, We follow the implementation in LDM. GN is a very common operation in attention mechanism.
What is the motivation for adding group normalization in the SeFB module, and what is the purpose of this operation? I did not find any relevant explanations in the article.