-
Is this normal?
-
I implemented the code with some other source codes,Im sure that the parts are right beacase i checkd them Independently,but i got the same nan loss as you,when trained 100 iters about,the loss beca…
-
hi, this project use VQVAE to compress video into small latent space, and latent embedding dim is `512` or `256`. But in LDM, they usually use very small embedding dim `4` or `3`, SD use `4`. Will th…
-
Hello.
I was deeply impressed by your paper.
Therefore, I would like to apply your paper's method to other networks.
Can this method be applied to other models such as VQ-VAE, not just StyleGANv…
-
Hello, I have a question about the image reconsturction via VAR.
I want the transformer model to predict the ground truth tokens, just like in the training situation, by obtaining image tokens throug…
-
Hi, thank you for your work.
I have a question regarding VQ experiment in the paper.
#z_spec_q_st, z_spec_q
did you use z_spec_q_st instead of z_spec ?
what happen with the indices z_spec_q ?
…
-
## リンク
https://arxiv.org/pdf/2002.03788.pdf
## どんなもの?
- VQ-VAE TTSを提案
## 先行研究と比べてどこがすごい?
- 時系列間の潜在変数の変化をモデリングすることにより高品質な音声合成を実現
## 技術と手法のキモはどこ?
- 以下の2段階学習で構成されている
1. VQ-VAEで韻律を離散的な潜在変数とし…
-
# Neural Discrete Representation Learning #
- Author: Aaron van den Oord, Oriol Vinyals, Koray Kavukcuoglu
- Origin: https://arxiv.org/abs/1711.00937
- Related:
- https://avdnoord.github.io/…
-
@shonenkov Great work everyone!
As far as I can tell, there is only VAE decoder with DWT and no corresponding encoder.
Encoding with get_vae(dwt=True) produces the same number of tokens as get_vae(d…
-
## 一言でいうと
離散潜在表現を学習するVQ-VAEを利用して音楽生成を行った研究。VQ-VAE-2のように潜在表現を階層状にしているが(音声の圧縮度に応じたEncoderを用意)、各階層の表現が壊れないよう全結合して出力せず個別のDecoderをでそれぞれ復元・学習する。歌詞とAttentionで対応付けた学習も行っている。
![image](https://user-images…