Chrixtar / latentsplat

[ECCV 2024] Implementation of latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction
https://geometric-rl.mpi-inf.mpg.de/latentsplat/
MIT License
146 stars 3 forks source link

Generating Novel Views from Custom Multi-View Images #11

Open Haimzis opened 3 months ago

Haimzis commented 3 months ago

Thank you for the amazing work on this project.

I have a set of custom images of a scene taken from different views. I would like to generate novel views based on pairs of reference image.

From my understanding, the current code is tied to specific datasets (e.g., co3d, re10k, etc.). I'd love to get some guidance on how to adapt the code to work with my custom multi-view images.

Questions:

  1. Generalization: Assuming my dataset is very similar to re10k, is the checkpoint generalized enough?

  2. Customization of Multi-View Images: What specific customization do I need to make to my multi-view images in order to use them with your code? Are there any specific formats or structures that my data should follow?

  3. Scripts to Use: Which scripts should I use to generate novel views from my reference images? Are there any modifications required in the scripts to accommodate custom datasets?

Thank you again for this awesome work!