search

sinoyou / nelf-pro

repo for paper NeLF-Pro: Neural Light Field Probes
Apache License 2.0
67 stars 2 forks source link

Scuol dataset #2

Open VerseWei opened 4 days ago

VerseWei commented 4 days ago

Thank you for sharing this work! May I ask if you can share the experimental data of scuol? I used colmap to process it but failed.

sinoyou commented 4 days ago

Hi, thanks for your interest.

Currently, I am not sure whether we are able to release the scuol scene due to the copyright issue. It requires further discussion.

But at first let's try to fix your problem from scratch. Could you provide more information about the error message?

FYI, during our experiment, we encountered following problems:

0 We use ns-process-data in nerfstudio to do SfM, as it provides more data format and user-friendly interface.

1 COLMAP processing time: default colmap uses vocab-tree matcher which takes 1 or 2 days to finish the full resolution scuol video. Instead, you can try sequential matcher(take only several hours) or downsample the video resolution or use shorter video sample.

2 Video trimming: the original video contains intro and outro which may not be feasible for 3D reconstruction. We suggest manual removal.

VerseWei commented 4 days ago

I have closed it due to failure. I uniformly extracted about 1800 images from the edited video, with a resolution of 1920 x 1080. The colmap was reconstructed and layered, which means it was recognized as two unrelated scenes. @sinoyou

sinoyou commented 2 days ago

Sorry for a late reply, I am on vacation.

We encountered the similar situation when we use default colmap vocabulary tree matcher. Specifically, there were two views which are far from the rest of views. This issue could be fixed by using a sequential matcher.