NVlabs / instant-ngp

Instant neural graphics primitives: lightning fast NeRF and more
https://nvlabs.github.io/instant-ngp
Other
15.86k stars 1.91k forks source link

any suggestions on the nerf result from kitti scene (single rgb camera) #1464

Open ZJLi2013 opened 11 months ago

ZJLi2013 commented 11 months ago

hi, experts, thanks for instant-ngp(ingp). looks ingp has the great performance in both training hrs, and gpu memory. i am working on reconstruct kitti scene with ingp, but the results is very coarse:

so far only using single rgb camera(camera_02) as input, a few specs:

any suggestions to improve this?

Thanks ZJ

0w0h0y commented 10 months ago

I meet a same problem with you. Did you find a solution?

Augusthyq commented 6 months ago

hi, experts, thanks for instant-ngp(ingp). looks ingp has the great performance in both training hrs, and gpu memory. i am working on reconstruct kitti scene with ingp, but the results is very coarse:

so far only using single rgb camera(camera_02) as input, a few specs:

* camera model:  Point Grey FL2-14S3C-C

* image size 1342 x 375

* for dynamic mask, I am using the default predictor from `colmap2nerf.py`

* training commands:
  `python3 ./scripts/run.py  --mode nerf  --train  --scene /ingp/output/kitti_transform.json --n_steps 20000    --width 1242    --height 375    --save_snapshot /ingp/output/kitti_left_rgb_step20k.msgpack --near_distance 0.0 `

* output:
  ![w680](https://private-user-images.githubusercontent.com/3397714/273489414-e5450f6d-44a5-497f-aef6-bd7467c37249.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTAyMTk2MDUsIm5iZiI6MTcxMDIxOTMwNSwicGF0aCI6Ii8zMzk3NzE0LzI3MzQ4OTQxNC1lNTQ1MGY2ZC00NGE1LTQ5N2YtYWVmNi1iZDc0NjdjMzcyNDkucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDMxMiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDAzMTJUMDQ1NTA1WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MGY4MDI4ZWQxOTU0NzdmM2E1NGFmZGM4ZTgyOWZlOTBhZjY5NWRlMzgxMTNjZjllNmUyNWY5Zjc5Yjc1MTZkMiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.yrr6uWtQnbig2CngyouXsJi9nI1bioiHgkA-RKHGZh0)

any suggestions to improve this?

Thanks ZJ

Hi, I meet the same problem. Have you solved it? It's very important for me. Thank you for your help!