broadinstitute / keras-rcnn

Keras package for region-based convolutional neural networks (RCNNs)
Other
552 stars 224 forks source link

Path Aggregation Network for Instance Segmentation #207

Open 0x00b1 opened 6 years ago

0x00b1 commented 6 years ago

Path Aggregation Network for Instance Segmentation Shu Liu, Lu Qi, Haifang Qin, Jianping Shi, Jiaya Jia. IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), 2018 (Spotlight Presentation) Ranked No. 1 of COCO 2017 Detection Challenge in Instance Segmentation track Ranked No. 2 of COCO 2017 Detection Challenge in Object Detection track

The way that information propagates in neural networks is of great importance. In this paper, we propose Path Aggregation Network (PANet) aiming at boosting information flow in proposal-based instance segmentation framework. Specifically, we enhance the entire feature hierarchy with accurate localization signals in lower layers by bottom-up path augmentation, which shortens the information path between lower layers and topmost feature. We present adaptive feature pooling, which links feature grid and all feature levels to make useful information in each feature level propagate directly to following proposal subnetworks. A complementary branch capturing different views for each proposal is created to further improve mask prediction. These improvements are simple to implement, with subtle extra computational overhead. Our PANet reaches the 1st place in the COCO 2017 Challenge Instance Segmentation task and the 2nd place in Object Detection task without large-batch training. It is also state-of-the-art on MVD and Cityscapes.

https://arxiv.org/abs/1803.01534