search

lucidrains / magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch
MIT License
565 stars 34 forks source link

Pixelated image reconstruction #29

Open coolbunnyx opened 10 months ago

coolbunnyx commented 10 months ago

Trained the model on a set of 10K images (randomly cropped 128 x 128 patches) for 6K iteration with a batch size of 8. The output looks pixelated. Is this what is expected, or the output should somehow look similar to the input? Any feedbacks are appreciated!

2024-01-07_19-45-46

BenicioEnriquez commented 10 months ago

@coolbunnyx is there any chance you could share the script you used to train this?

syyxsxx commented 10 months ago

meeting the same problem，Have you solved this problem？ @coolbunnyx

coolbunnyx commented 10 months ago

meeting the same problem，Have you solved this problem？ @coolbunnyx

I've given it up; not sure if the issue is the code or just me lacking the computing resources to make it converge quickly to the right solution. Intuitively, it should converge to something similar to the input image instead of getting pixelated, though I might be wrong.

Borhanv-nd commented 9 months ago

@lucidrains do you have any comment, I am facing the same issue

canqin001 commented 9 months ago

Trained the model on a set of 10K images (randomly cropped 128 x 128 patches) for 6K iteration with a batch size of 8. The output looks pixelated. Is this what is expected, or the output should somehow look similar to the input? Any feedbacks are appreciated!

2024-01-07_19-45-46

Could you please share your config for training? I just cannot reproduce anything except the black blocks. Many thanks!

Jason3900 commented 8 months ago

Trained the model on a set of 10K images (randomly cropped 128 x 128 patches) for 6K iteration with a batch size of 8. The output looks pixelated. Is this what is expected, or the output should somehow look similar to the input? Any feedbacks are appreciated! 2024-01-07_19-45-46

Could you please share your config for training? I just cannot reproduce anything except the black blocks. Many thanks!

It may work if you turn off the use_gan.

void-main commented 8 months ago

@lucidrains @Borhanv-nd I'm running into the same situation, do you have any comments on this issue? Do I need to train more steps?