search

chengzhag / PanFusion

🍳 [CVPR'24 Highlight] Pytorch implementation of "Taming Stable Diffusion for Text to 360° Panorama Image Generation"
https://chengzhag.github.io/publication/panfusion/
MIT License
159 stars 18 forks source link

Is it possible from IMG to 360 img? #2

Open venturaEffect opened 5 months ago

venturaEffect commented 5 months ago

First of all congrats!

My question is pretty simple, is it possible to do it not just from text also by giving an image as input?

If not, is there a way that I could look into it to try to figure it out?

Appreciate.

chengzhag commented 4 months ago

Hi, @venturaEffect, I think PanoDiffusion would be a good starting point. Or you can try the inpainting model provided by MVDiffusion.

venturaEffect commented 4 months ago

Thank you. But I'm getting no answer from MatterPort3D to use the DB. So I'm stuck and can't continue... Any clue how to get forward on this?

Appreciate.