search

donydchen / mvsplat

🌊 [ECCV'24 Oral] MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Images
https://donydchen.github.io/mvsplat
MIT License
697 stars 31 forks source link

Seeking advice on my own dataset #51

Open lingbo-yu opened 1 month ago

lingbo-yu commented 1 month ago

@donydchen Hello, I am testing on my dataset and I found that my program keeps running here in the program. https://github.com/donydchen/mvsplat/blob/7a2afb65856caf11215c4495573d390774245f28/src/dataset/dataset_re10k.py#L89

After debugging, I found that the fov calculated by the intrinsic is too large, causing the program to keep jumping out here. https://github.com/donydchen/mvsplat/blob/7a2afb65856caf11215c4495573d390774245f28/src/dataset/dataset_re10k.py#L143

Can I directly change the relevant parameters in config to adapt to this problem? I would be happy if you can provide any advice.

donydchen commented 1 month ago

Hi @lingbo-yu, I think it should be OK, you can try to set a larger value for dataset.max_fov, although I am not sure how good the performance will be. Are you working with images taken by a fish-eye camera? I think the current max_fov=100 should already work for most images captured by normal cameras. Besides, do ensure that your provided camera intrinsics are correctly normalized, more related information can be found at https://github.com/donydchen/mvsplat/issues/28.