Model you used is Res2Net50 and not 34, so rename would be good.
It'd be good to parameterize use of SE layer, basewidth and scale values.
Run code to make sure, no bugs.
Also, to note that Microsoft used Res2Net blocks but overall backbone architecture was different form one presented in Res2Net paper. Details of their architecture can be found in references of the paper.
Include support for Res2Net models, as used in microsoft 2020 diarization system: https://arxiv.org/pdf/2010.11458.pdf