chigozienri / VQGAN-CLIP-animations

134 stars 28 forks source link

Add MSE regularization #11

Open okiyama opened 3 years ago

okiyama commented 3 years ago

Apologies if my terminology is not good, I'm not very well versed in the behind the scenes. Recently, there's been a notebook which added linearly decreasing MSE values, and the results are IMO much better and more coherent. Here's the notebook: https://colab.research.google.com/drive/1gFn9u3oPOgsNzJWEFmdK-N9h_y65b8fj?usp=sharing and here's a Reddit post on it: https://www.reddit.com/r/bigsleep/comments/onmz5r/mse_regulized_vqgan_clip/

Would it be feasible and/or straightforward to add that ability to your notebook? I'm going to take a crack at it myself but not knowing the code I'll be basically just working through the diffs and blindly grabbing lines that seem like they'll help.

chigozienri commented 3 years ago

That's a great idea! I'll have a look into it, it should be possible.