search

Project-MONAI / research-contributions

Implementations of recent research prototypes/demonstrations using MONAI.
https://monai.io/
Apache License 2.0
995 stars 328 forks source link

Question about SwinUNETR #195

Open chaoscls opened 1 year ago

chaoscls commented 1 year ago

https://github.com/Project-MONAI/MONAI/blob/ab800d8413df5680161ea00fb3d6c1a7aa8dd04b/monai/networks/nets/swin_unetr.py#L304 Why isn't a encoder layer after hidden_states_out[3] like the other hidden outputs?

tangy5 commented 1 year ago

Hi @chaoscls , thanks for the interests of the work. The hidden out 3 is a design option, the goal is to keep 4 times of downsampling to avoid the model to be too large and complex. You could freely reformat the hidden to 5 times downsamples and connect all hidden layers to skip connection and outputs. That will increase the # of parameter by a bit. From our observation, the difference is minimal. Thank you.