fangchangma / sparse-to-dense

ICRA 2018 "Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image" (Torch Implementation)
Other
417 stars 95 forks source link

About using resnet model pretrained on imagetNet. #4

Closed chenchr closed 6 years ago

chenchr commented 6 years ago

Hello. Thank you for releasing the code. I read your paper, and found that you used resnet model pretrained on imagetNet. However, as the model trained on imageNet should have input channels as 3 at first laye, when turning to training sparse to dense with rgbd data as input, the input channels become 4. How to deal with this problem? Thanks!

fangchangma commented 6 years ago

Hi. The first convolution layer is not from the imageNet-pretrained model but instead trained from scratch. https://github.com/fangchangma/sparse-to-dense/blob/5994c396ad70d0e1c22f9c985df117edc0348f78/models/resnet-kitti.lua#L226