Walter0807 / MotionBERT

[ICCV 2023] PyTorch Implementation of "MotionBERT: A Unified Perspective on Learning Human Motion Representations"
Apache License 2.0
956 stars 116 forks source link

Transfer learning using dataset with different keypoints #125

Open axelssons opened 4 months ago

axelssons commented 4 months ago

Thank you for the great work with MotionAGFormer!

I have an own dataset with a different set of keypoints compared to H36M, with additional keypoints on the toes. Note that this dataset is small compared to H36M. The goal is to use the pre-trained (on H36M) model and train/finetune it on my own dataset using transfer learning, getting it to output my custom set of keypoints. How would one go about freezing the convolutional base layers and replacing the final fully connected layer / head layer with new ones having random weights on which we train? I assume this is a good option to solve the problem.

Best regards, Jonathan

1259666087 commented 3 months ago

My thoughts are the same as yours. Did your code run successfully?