autonomousvision / occupancy_networks

This repository contains the code for the paper "Occupancy Networks - Learning 3D Reconstruction in Function Space"
https://avg.is.tuebingen.mpg.de/publications/occupancy-networks
MIT License
1.49k stars 291 forks source link

What is voxel file used for during ONet training from pointcloud? #42

Open jnyjxn opened 4 years ago

jnyjxn commented 4 years ago

Hello,

Thank you for this great work and clean codebase!

I am trying to relate the training script of your work to the CVPR paper and I want to better understand the use of the voxel data (e.g. "model.binvox") when training from pointcloud data. Is it used during training, or only at inference?

By extension, is the performance of ONet highly dependent on the use of this voxel data? For example, does the performance improve if the resolution of the grid is increase from 32x32x32 to 64x64x64?

AlexsaseXie commented 4 years ago

Voxel data is only used for evaluation. Nearly all of the deep learning network approaches to do the task of 3D reconstruction use voxel iou as a metric but not a component of the final loss function because iou loss cannot calculate gradients. Increase the relosution of the voxel cannot actually affect the reconstructed result of ONet(for voxel don't participate training) but may make ONet look better than other approach(other approaches usually cannot handle high resolution, or suffer from huge memory space cost). This is one of ONet's superior.