ChenFengYe / motion-latent-diffusion

[CVPR 2023] Executing your Commands via Motion Diffusion in Latent Space, a fast and high-quality motion diffusion model
https://chenxin.tech/mld/
MIT License
574 stars 51 forks source link

Training configuration on KIT dataset #13

Open Dean-UQ opened 1 year ago

Dean-UQ commented 1 year ago

Hi, I would like to train MLD on KIT dataset. What should I tune in this configuration file https://github.com/ChenFengYe/motion-latent-diffusion/blob/main/configs/config_vae_humanml3d.yaml ? Its JOINT_TYPE may be configure as 'mmm'? Many Thanks

ChenFengYe commented 1 year ago

If you use the kit from humanml3d (like below), you only need to change humanml3d => kit https://github.com/ChenFengYe/motion-latent-diffusion/blob/279e0167c5370671f7ab523ae56310ec43e24439/configs/config_mld_humanml3d.yaml#L24 https://github.com/ChenFengYe/motion-latent-diffusion/blob/279e0167c5370671f7ab523ae56310ec43e24439/configs/config_mld_humanml3d.yaml#L47 https://github.com/ChenFengYe/motion-latent-diffusion/blob/279e0167c5370671f7ab523ae56310ec43e24439/configs/config_mld_humanml3d.yaml#L56 Importantly, you do not need to change the joint type. https://github.com/ChenFengYe/motion-latent-diffusion/blob/279e0167c5370671f7ab523ae56310ec43e24439/configs/config_mld_humanml3d.yaml#L67

You can also check #2

We do not suggest you download KIT from its official website, you can check the KIT provided by HumanML3D. The below is from the readme of HumanML3D

For KIT-ML dataset, you could directly download [Here]. Due to the distribution policy of AMASS dataset, we are not allowed to distribute the data directly. We provide a series of script that could reproduce our HumanML3D dataset from AMASS dataset.

https://drive.google.com/drive/folders/1MnixfyGfujSP-4t8w_2QvjtTVpEKr97t

nefeliandreou commented 1 year ago

are there any more config changes that need to be applied to reproduce the results reported in table 2?

weleen commented 11 months ago

@nefeliandreou have you reproduced the reported results?

ChenFengYe commented 11 months ago

@weleen Do you need the KIT pre-trained model or the implementation of this training process?

weleen commented 11 months ago

@weleen Do you need the KIT pre-trained model or the implementation of this training process?

Thank you for your prompt response, it’s really nice if you could provide the pretrained model and log files.

shouyezhe commented 11 months ago

@weleen Do you need the KIT pre-trained model or the implementation of this training process?

Hello, I've encountered issues while training KIT. Could you provide the pre-trained model? Thank you very much for your contributions to the research community.

GioFic95 commented 7 months ago

Hi @ChenFengYe, could you please provide the checkpoint of MLD pre-trained on KIT? I would need it as well. Thank you very much in advance.

dlg-dlg commented 4 months ago

Hi @ChenFengYe, I've encountered same issues while training KIT. Could you provide the pre-trained model? Thank you very much.