Open rahimentezari opened 2 years ago
Dear Rahim,
Hmm, are you using the flag to handle skip connections: --handle-skips
? Can you please run with that if not already?
Yes, currently Batchnorm is not supported for simplicity. But it should not be that hard to handle, e.g., one simple idea is that you can 'hit' the batchnorm parameters (which are anyways neuronwise) by the resulting permutation matrix of that layer. I will also give it a try one of these days. Feel free to share your experience if you try this here or over email.
Cheers, Sidak
Hi Sidak, I have tried running the code with --handle-skips but still I run into this error.
Dear Sidak, Thanks again for your code. I was going to run your an example using your resnet checkpoints. To do this, cifar.zip and resnet_models.zip are extracted and the following command is run (it seems the provided checkpoint are with no BN):
python main.py --gpu-id 0 --model-name resnet18_nobias_nobn --n-epochs 300 --save-result-file sample.csv --sweep-name exp_sample --exact --correction --ground-metric euclidean --weight-stats --activation-histograms --activation-mode raw --geom-ensemble-type acts --sweep-id 21 --act-num-samples 200 --ground-metric-normalize none --activation-seed 21 --prelu-acts --recheck-acc --load-models ./resnet_models/ --ckpt-type best --past-correction --not-squared --dataset Cifar10
However, the code exited with the following error (seems the shortcut is making the trouble):
Secondly, the code is not working with BatchNorm, is that right?