Closed kobybibas closed 1 year ago
Hi, thanks!
The panorama is a private case of the formulation in Eq. 4. Specifically, Fi map the panorama to square crops, and the weights Wi are set to one (Eq. 7 in the paper).
In terms of implementation, indeed at each denoising step we take the average over overlapping regions. Note that the 'count' parameter amounts for the denominator in Eq. 5.
Let me know if you have any other questions:)
Thanks for the awesome paper and very clear code!
For the panorama use case, can the method be reduced to the following implementation: At each de-noising step, take the average pixel value of the overlapping regions https://github.com/omerbt/MultiDiffusion/blob/f91b1c25fd14826d46f0f21c6f099b57fc446737/panorama.py#L138
If yes, how does the least squares formulation of the paper align with it?![image](https://github.com/omerbt/MultiDiffusion/assets/20231227/ff4ae91b-eab5-4abb-a592-19ca86073817)
And again, thanks!