williamyang1991 / FRESCO

[CVPR 2024] FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation
https://www.mmlab-ntu.com/project/fresco/
Other
731 stars 71 forks source link

Using loops causes colors to get darker #50

Closed Sonia-kong closed 3 months ago

Sonia-kong commented 3 months ago

Hi, thanks for your wonderful jobs. I noticed that there is a color correction switch in rerender. I would like to ask why there is no such item in Fresco, because I have encountered a problem now: when using diffsers, the color will deepen after multiple iterations. Thanks a lot.

williamyang1991 commented 3 months ago

rerender has two color-realted process.

Color-aware AdaIN is the contribution claimed in rerender, not the contribution of Fresco, and we didn't notice obvious darken color on our test videos (maybe our video is not long enough to encouter your problem?), So we didn't include it in Fresco.

Sonia-kong commented 3 months ago

Thanks for your reply. My test video is indeed quite long. I am considering how to solve the problem of color shift. Thanks for your answer.