search

openai / jukebox

Code for the paper "Jukebox: A Generative Model for Music"
https://openai.com/blog/jukebox/
Other
7.81k stars 1.41k forks source link

Where is the codebook loss? #129

Open waynchi opened 4 years ago

waynchi commented 4 years ago

Hi! I'm going through the codebase trying to understand the various losses that you use. I can find the recons and commit losses, but I can't find the codebook loss anywhere. Could someone point me to where that would be?

Thanks!

MlWoo commented 4 years ago

@waynchi The paper explains it very clear. "To speed up training, the loss of codebook instead uses EMA up- dates over the codebook variables."