Possible to generate 360 landscapes in equirectangular mode from exisiting NON-360 landcapes?

manicman1999 / StyleGAN2-Tensorflow-2.0

StyleGAN 2 in Tensorflow 2.0

MIT License

486 stars 112 forks source link

Possible to generate 360 landscapes in equirectangular mode from exisiting NON-360 landcapes? #16

Open donblaauw opened 3 years ago

donblaauw commented 3 years ago

Diving into GAN en deepfakes and disneyfying my portret 😄 I stumbled upon your github project.. As I write kids adventures in my spare time and making 360˚ worlds interactive I wondered if one could generate 360˚ landscapes from non 360 images..

any ideas? Equirectangular images look pretty weird so stitching this is a daunting task for me.. well impossible to say. could GAN help me?

99991 commented 2 years ago

In Figure 17 on page 14 in Image Generators with Conditionally-Independent Pixel Synthesis the authors show seamless panoramas generated with a model that has been trained on regular images. I'd imagine that it would also be possible to warp the coordinate grid to produce equirectangular panoramas.