Last layer of tf2 model is dense and a conv2d in pytorch

google-research / big_transfer

Official repository for the "Big Transfer (BiT): General Visual Representation Learning" paper.

https://arxiv.org/abs/1912.11370

Apache License 2.0

1.5k stars 175 forks source link

Closed Molaire closed 4 years ago

Molaire commented 4 years ago

I am probably reading things wrong, but if so, where would be the dense layer of the head located in the pytorch model?

lucasb-eyer commented 4 years ago

Dense and Conv2d with filter size 1x1 are the same thing, just different implementations :) It does not matter which of the two is used.