SUN-1024 / DA-TransUnet

DA-TransUNet: Combining Dual Attention of Position and Channel with Transformer U-net for Medical Image Segmentation
GNU General Public License v3.0
120 stars 10 forks source link

about comparison of trainable parameters of Transunet and DA-transunet in tensorflow #16

Open Romita-ai opened 1 month ago

Romita-ai commented 1 month ago

in the DA-transunet paper the number of trainable parameters for Transunet and DA-transunet are 105million and 107millions respectively. But when i write the model in tensorflow the number of trainable parameter of Transunet with resnet50 and without resnet wth the Image_size=(224,224,3), embed_dim=512, MLP size= 3072, num_head=12, num_transformer_layer=12 is 409million and 406 million. so i want to know where should i modify my code.