Training with RGBD - Githubissues

matterport / Mask_RCNN

Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow

Other

24.52k stars 11.68k forks source link

Training with RGBD #1746

Open ApoorvaSuresh opened 4 years ago

ApoorvaSuresh commented 4 years ago

Hi, I am training this model with my own data- RGBD. But I am unable to apply image augmentation. Do the image augmentors works only on 3 channel images?

ApoorvaSuresh commented 4 years ago

i have tried to augment the depth channel as heatmaps.

But I always get nan loss for rpn_bbox_loss. can someone help?

orestis-z commented 3 years ago

This repository that extends Mask R-CNN for RGB-D data might be of interest to you: https://github.com/orestis-z/mask-rcnn-rgbd. I includes also image augmentation for all 4 channels: https://github.com/orestis-z/mask-rcnn-rgbd/blob/d590e0f5085f8cbe895a6698e284426fd0116aa4/model.py#L1225-L1277