hi , im really preciated by the work. but i have a question about "pre_logits". Did you set the "representation_size" as defualt None when you finetune imagenet21k_ViT-B_16.npz with imagenet 1k?
i mean the code about models.py
if representation_size is not None:
x = nn.Dense(x, representation_size, name='pre_logits')
x = nn.tanh(x)
else:
x = IdentityLayer(x, name='pre_logits')
hi , im really preciated by the work. but i have a question about "pre_logits". Did you set the "representation_size" as defualt None when you finetune imagenet21k_ViT-B_16.npz with imagenet 1k?
i mean the code about models.py