Question about finetuning on small datasets

Arnav0400 / ViT-Slim

Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”

MIT License

243 stars 17 forks source link

Question about finetuning on small datasets #11

Open HankYe opened 1 year ago

HankYe commented 1 year ago

Hi, authors! Thanks for your great work! But I have a question about the hyper-parameter setting of fine-tuning on small datasets, which is not mentioned in the paper. I'd appreciate it greatly if you could share some details!