guanfuchen / semseg

常用的语义分割架构结构综述以及代码复现 华为媒体研究院 图文Caption、OCR识别、图视文多模态理解与生成相关方向工作或实习欢迎咨询 15757172165 https://guanfuchen.github.io/media/hw_zhaopin_20220724_tiny.jpg
770 stars 164 forks source link

Multi-Scale Context Aggregation by Dilated Convolutions #12

Open guanfuchen opened 6 years ago

guanfuchen commented 6 years ago

related paper

摘要
State-of-the-art models for semantic segmentation are based on adaptations of convolutional networks that had originally been designed for image classification. However, dense prediction problems such as semantic segmentation are structurally different from image classification. In this work, we develop a new convolutional network module that is specifically designed for dense prediction. The presented module uses dilated convolutions to systematically aggregate multi-scale contextual information without losing resolution. The architecture is based on the fact that dilated convolutions support exponential expansion of the receptive field without loss of resolution or coverage. We show that the presented context module increases the accuracy of state-of-the-art semantic segmentation systems. In addition, we examine the adaptation of image classification networks to dense prediction and show that simplifying the adapted network can increase accuracy.
guanfuchen commented 6 years ago

空洞卷积原理

image

image

image

guanfuchen commented 6 years ago

多尺度上下文聚合单元

image

该单元需要不同的初始化策略

image

Caffe模型中的可视化

image

guanfuchen commented 6 years ago

结果

使用了空洞卷积作为前端的结果更为精细

image

数据集上的性能比较

image

image

guanfuchen commented 6 years ago

总结与展望

image