JieShibo / PETL-ViT

[ICCV 2023] Binary Adapters, [AAAI 2023] FacT, [Tech report] Convpass
MIT License
162 stars 7 forks source link

About the weight initialization for the 'adapter_conv' in Convpass #13

Closed Harry-zzh closed 10 months ago

Harry-zzh commented 11 months ago

Thank you for your outstanding work! Regarding the weight initialization method for the 'adapter_conv' in Convpass, some datasets are initialized using Xavier Uniform initialization, while others are not. I would like to inquire whether the different weight initialization methods for different datasets were determined through experiment results or if there is a specific rationale for the selection. Looking forward to your reply. Thanks!

JieShibo commented 10 months ago

The weight initialization methods for different datasets were determined through experiment results.