search

meyerls / FruitNeRF

[Conference] Offical Code for FruitNeRF - Inegrated into Nerfstudio
https://meyerls.github.io/fruit_nerf
4 stars 0 forks source link

How to align your images? #1

Open oliver-batchelor opened 1 month ago

oliver-batchelor commented 1 month ago

I tried with COLMAP to align your dataset first one by one, then secondly all images at once - they're 3 trees in a row right? But struggled to get it to do anything useful. I'm curious what settings you used?

You already have posted camera extrinsics - however I wanted the sparse point-cloud too. I also tried with Metashape and had better success (though still quite a few images failed to align).

meyerls commented 1 month ago

Yes indeed there are 3 trees in a row. The original plan was that the trees should be considered individually. I was using handcrafted transformation matrices to align all 3 trees. So I would recommend using the provided transform.json for good results.

If you want the sparse pcd you should try COLMAP on every tree individually and fuse them afterwards. If you are interested in the manual alignment and to fuse the extrinsics, please let me know.

oliver-batchelor commented 1 month ago

Thanks! I will try a few things.

We've been working on very similar ideas. We also have a dataset of apple fruitlets (multiple captures taken from a robot arm) that is quite similar in some ways. We could share it if it is useful to you—we probably just need to filter out the worst captures.