-
Hi! Thank you for your wonderful work and for releasing the code publicly! Could you please tell whether there is an easy way (from the implementation perspective) to generate videos longer than 16 fr…
-
Hello! Thank you for this great library and the vq vae implementation.
While using the ema vqvae with a distributed strategy (in this case TPU), I get a value error when reducing the grads across a…
-
Hi. Thanks for this great work. I have some questions on the general status of video generative modeling and the implementation sides, which I would appreciate answers from authors and other people wh…
-
I am wondering if there is a discrepancy between the how inference is explained in the paper and how it is implemented in `test.py`. To be specific, the paper says "During inference, only Gs and Gt ar…
-
Is the beta supposed to be applied to the commit loss where z_q is frozen rather than z is frozen?
https://github.com/CompVis/taming-transformers/blob/1bbc027acb6a47e4eb348d611f9af53f1038ffee/tamin…
-
Thanks for your amazing job, the result is amazing. But the inference time is such long.
On 32G V100 the inference time is 34ms. Is it normal?
-
I am trying to train a VQGAN on an 8-core TPU. Have you successfully trained a VQGAN on a single TPU using this codebase?
-
In this repository, it implements a two level VQ-VAE, matching that of Figure 2 in the original paper.
In the paper it also mentions three level VQ-VAE, as seen in Figure 3. Given your implementat…
-
Hi, I was wondering if the "EMA codebook update" of the vqvae should be runned when training the transformer? (specifically, should line 178-198 in vqvae.py be running when training the transformer?)
…
-
Hi @pesser and @rromb,
thanks for the amazing work!
I read your paper and code line-by-line, and I found that the commitment loss weighting factor (beta) in the code is slightly different from wha…