Fine tuning from specific layer number

google-research / big_transfer

Official repository for the "Big Transfer (BiT): General Visual Representation Learning" paper.

https://arxiv.org/abs/1912.11370

Apache License 2.0

1.5k stars 175 forks source link

Fine tuning from specific layer number #53

Open sumedhvdatar opened 3 years ago

sumedhvdatar commented 3 years ago

Is there a way where we can specify a specific layer number and start training specific layers with BIT using tensorflow. Currently number of layers it shows 2 and when I specify the layer number accuracy drops to single digit. Looks like its training from scratch. Looking for a correct way to fine tune