SamsungLabs / MLI

Novel View Synthesis with multiplane/multilayer representation: CVPR2022, WACV2023
Other
143 stars 10 forks source link

HOW to get Novel View for a specified pose #12

Closed Sunineu closed 1 year ago

Sunineu commented 1 year ago

It's really a great work and I have studied your work for a long time. I have used the colab to generate MLI and construct a single representation for a scene.Now ,i wonder how to generate some novel views for specified poses. I'm looking forward to hearing from you.

palsol commented 1 year ago

Hello! I think the easiest way is: 1) Put your data in the format of RealEstate2 dataset. Format is described in the head of the dataset class 2) Implement custom trajectory_generator wich returns views that you want to render. Or you can use existed one, from those which have been used in our videos. 3) Compose config for generating validation dataset from your RealEstate2 format dataset. Config example. 4) Generate val dataset with your config. 5) Render your validation dataset which contains desired poses like here