I trained your deform-conv on the origin data. It gets 70% on origin test and 89% on scaled data, while the the normal CNN model trained on origin data gets 99% on origin test and 64% on scaled data. The deform-conv may not work.
So I try to delete two of the deform-conv, keep one left. It gets 93% on origin test and 97% on scaled data.
Your deform-conv may not work. I think you should check it.
I trained your deform-conv on the origin data. It gets 70% on origin test and 89% on scaled data, while the the normal CNN model trained on origin data gets 99% on origin test and 64% on scaled data. The deform-conv may not work. So I try to delete two of the deform-conv, keep one left. It gets 93% on origin test and 97% on scaled data. Your deform-conv may not work. I think you should check it.