SwinTransformer / Swin-Transformer-Object-Detection

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Object Detection and Instance Segmentation.
https://arxiv.org/abs/2103.14030
Apache License 2.0
1.81k stars 381 forks source link

add swin transformer moe as backbone #209

Open adverbial03 opened 1 year ago

adverbial03 commented 1 year ago

Motivation

In order to expand the parameters of the swing transformer backbone network and improve its monitoring effect, I added Swin Transformer MoE (referred to as Swin-T MoE hereafter) as a new backbone network.

Modification

I added Swin Transformer MoE (referred to as Swin-T MoE hereafter) as a new backbone network : .\mmdet\models\backbones\swin_transformer_moe.py

As the output of Swin-T MoE is different from Swin-T, I modified the extract_feat function in .\mmdet\models\detectors\two_stage.py.

BC-breaking (Optional)

I think no.

Use cases (Optional)

I provided the relevant configuration files for reference: contains the parameters for the Swin-T MoE backbone network:

.\configs\swin\cascade_mask_rcnn_swin_moe_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco.py

contains the modified configuration for the backbone network:

.\configs\swin\cascade_mask_rcnn_swin_moe_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco.py

Thanks for your read.