search

Tangshitao / MVDiffusion

MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion, NeurIPS 2023 (spotlight)
447 stars 21 forks source link

[Question] 360x180 degree equirectangular stitching #25

Closed phamkhactu closed 8 months ago

phamkhactu commented 8 months ago

Hi

I've seen that model can create panorama. If I have list of images contains almost degree. Could I use your model to create 360 image?

Best regrads, Tu

Tangshitao commented 8 months ago

Not sure I understand what you mean. Can you explain you questions in details?

phamkhactu commented 8 months ago

yeah,

I want to create 360 image like that. It is a 360 panorama image. it is created from multi sidle image from multi degree. I mean that: "Can your model combine multi image to create 360 panorama ?"

Tangshitao commented 8 months ago

Yes, we first generate 8 panoramic images and you can stitch them into a panorama. We release the stitch codes here. https://github.com/Tangshitao/MVDiffusion/blob/main/generate_video_tool/pano_video_generation.py

phamkhactu commented 8 months ago

Yes, we first generate 8 panoramic images and you can stitch them into a panorama. We release the stitch codes here. https://github.com/Tangshitao/MVDiffusion/blob/main/generate_video_tool/pano_video_generation.py

Thanks for your reply.

Could you give me more doc about creating 8 panoramic images? I am a newbie in 360. I've use google street view, it use 42 images with interested point for making it. I have another question:

what is the minimize images need for creating 360 did you use? or Did you use video to making it?

Tangshitao commented 8 months ago

The project is for generating panoramic images. I guess what you need is to transform perspective images into panorama images. You can check the repo. https://github.com/timy90022/Perspective-and-Equirectangular