Hi and first, thank you for sharing such a fascinating work.
I am trying to experiment GKD based on EKD repository from TFace, following your recommendation.
EKD appears to be using (balanced, general) batch concepts and BalancedBatchSampler.
Do I need those for GKD as well? Or, just using DistributedSampler is fine?
Hi and first, thank you for sharing such a fascinating work. I am trying to experiment GKD based on EKD repository from TFace, following your recommendation. EKD appears to be using (balanced, general) batch concepts and BalancedBatchSampler. Do I need those for GKD as well? Or, just using DistributedSampler is fine?