search

google-research / big_transfer

Official repository for the "Big Transfer (BiT): General Visual Representation Learning" paper.
https://arxiv.org/abs/1912.11370
Apache License 2.0
1.5k stars 175 forks source link

Reproducing problems #70

Closed Sukeysun closed 2 years ago

Sukeysun commented 2 years ago

Hi, Thanks for your great work of these two articles! I am reproducing Knowledge distillation: A good teacher is patient and consistent using Flowers102 dataset. But I cannot reach the accuracy you got of Best from-scratch ResNet50(66.38%). Could you tell me the hyperparameter you used, such as the learning rate schedule, the optimizer? Thanks.