search

rstrudel / segmenter

[ICCV2021] Official PyTorch implementation of Segmenter: Transformer for Semantic Segmentation
MIT License
846 stars 175 forks source link

Can you use swin transformer as encoder? #46

Closed JunzheJosephZhu closed 2 years ago

JunzheJosephZhu commented 2 years ago

As in title, can you replace the standard ViT encoder with a swin transformer + FPN? Would this be a reasonable thing to try out?

rstrudel commented 2 years ago

You could probably replace ViT with a swin encoder indeed :) You could get improved performance given the downstream performances of Swin that are better than ViT on some tasks.