search

YoungSeng / QPGesture

QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation (CVPR 2023 Highlight)
82 stars 7 forks source link

Where is the codebook loss? #10

Closed RobinWitch closed 1 year ago

RobinWitch commented 1 year ago

I can find the reconstruction and commit losses as paper mentioned in equation(3), but I can't find the codebook loss anywhere. Could someone point me to where that would be ?

YoungSeng commented 1 year ago

Hello, the code of gesture-VQVAE is mainly borrowed from: https://github.com/lisiyao21/Bailando, without any significant changes.

RobinWitch commented 1 year ago

Sorry for reply late , emm in this code https://github.com/lisiyao21/Bailando , I still not find where codebook loss is , could you point out for me ?

YoungSeng commented 1 year ago

Sorry, I'm using Bailando's code directly, I'm not too sure about the details, you can ask the author of Bailando, good luck.

RobinWitch commented 1 year ago

Sorry to bother you , and thank you for your patient reply !

huifu99 commented 1 year ago

It may be that the EMA is used.