search

dvlab-research / ReviewKD

Distilling Knowledge via Knowledge Review, CVPR 2021
248 stars 34 forks source link

shapes and out_shapes values in ReviewKD #15

Open Nandan91 opened 2 years ago

Nandan91 commented 2 years ago

To me, it's confusing, how to set the "shapes" and "out_shapes" when the student is ResNet18 and the teacher is ResNet34 on CIFAR-100.

Is it shapes = out_shapes = [1, 8, 16, 32, 32]

or, shapes = out_shapes = [1, 4, 8, 16, 32]

akuxcw commented 1 year ago

It depends on the shape of features you used for distillation.