search

NVlabs / instant-ngp

Instant neural graphics primitives: lightning fast NeRF and more
https://nvlabs.github.io/instant-ngp
Other
16k stars 1.93k forks source link

Turntable footage #1201

Open arstropica opened 1 year ago

arstropica commented 1 year ago

Can colmap process turntable footage from a stationary camera? Currently, I am getting zero image matches for 150 images of a 360 turntable sequence.

toomy0toons commented 1 year ago

yes it does and it should perform much better than handheld 360 camera video

try removing background or shooting object within non-transparent box or in stable lighting

avclubvids commented 1 year ago

I got a successful turntable solve doing this:

  1. Put some texture on the turntable surface so that COLMAP sees the "ground" rotating correctly with the subject. You might want to put a border around the turntable platter and basically turn it from a flat disc into a short cylinder. You can clip this surface out with the aabb box cropping later.
  2. Shoot against as plain a background as possible. I used white but I would recommend black, as white ends up in the NeRF as a sphere of white clouds that you'll need to remove later.
  3. Clean up anything in the photos that is not the color of the background (again, black is best here)
  4. Process as normal, COLMAP should solve the cameras just fine.
arstropica commented 1 year ago

@avclubvids Thanks for the tips. I will try those suggestions.