leaderj1001 / Stand-Alone-Self-Attention

Implementing Stand-Alone Self-Attention in Vision Models using Pytorch
MIT License
456 stars 83 forks source link

Has anyone tried changing the batch size #23

Open sammens opened 4 years ago

sammens commented 4 years ago

I am having issues trying to change the batch size. The code produces a mismatch error each time I change the batch size. Below is the error I am getting; RuntimeError: size mismatch, m1: [4 x 8192], m2: [2048 x 5] at /pytorch/aten/src/THC/generic/THCTensorMathBlas.cu:283

iyaja commented 3 years ago

I was able to run the CIFAR10 experiments with different batch sizes using the --batch-size flag without any issues.