Modifying the Transformer layers in M4C model

facebookresearch / mmf

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

https://mmf.sh/

Other

5.46k stars 932 forks source link

Modifying the Transformer layers in M4C model #1180

Closed soonchangAI closed 2 years ago

soonchangAI commented 2 years ago

❓ Questions and Help

Hi, I want to change the fixed dimensions of Transformer layers for Multi-modal Transformer (MMT) of M4C. For example, layer 0 dimension = 100, layer 1 dimension = 300, layer 2 dimension = 200. How can I do this ?