[Questionnaire] Which model do you want to support in mmdeploy?

[VVsssssk]

Which model do you want to support in mmdeploy? Comment here. You can like a comment to increase model priority.		Model	Codebase	Backend	Number of likes	Released
1	Swin-Transformer	mmcls	tensorrt	2	v0.6.0
2	Second	mmdet3d	tensorrt	1
3	htc	mmdet	tensorrt	1
4	Segmenter	mmseg	tensorrt	1	v0.6.0
5	ConvNeXt	mmcls	tensorrt	1
6	MASTER	mmocr	tensorrt	1
7	ABINet	mmocr	tensorrt	1
8	BEVFormer	mmdet3d	tensorrt	1
9	Oriented R-CNN	mmrotate	tensorrt	1	v0.6.0
10	SAR	mmocr	tensorrt	1

Reference:

• [ ] MASTER: #623
• [ ] ABINet: #689
• [ ] BEVFormer: #688
• [ ] SAR: #630

[VVsssssk]

E.g: Swin-Transformer mmcls tensorrt

[OrcunCanDeniz]

second mmdet3d tensorrt

[haofanwang]

htc mmdetection tensorrt

[haofanwang]

segmenter mmsegmentation tensorrt

[starhou]

swin-transformer mmdet tensorrt

[starhou]

I haven't tried the conversion yet and I just used your example fater-rcnn. Maybe now, need to try.

[RunningLeon]

segmenter mmsegmentation tensorrt

@haofanwang Have you tried segmenter with mmdeploy?

[haofanwang]

segmenter mmsegmentation tensorrt

@haofanwang Have you tried segmenter with mmdeploy?

@RunningLeon , Yes, but I receive error messages as below

TypeError: upsample_bicubic2d() received an invalid combination of arguments - got (Tensor, NoneType, bool, list), but expected one of:
 * (Tensor input, tuple of ints output_size, bool align_corners, tuple of floats scale_factors)
      didn't match because some of the arguments have invalid types: (Tensor, NoneType, bool, list)
 * (Tensor input, tuple of ints output_size, bool align_corners, float scales_h, float scales_w, *, Tensor out)

And my command is

python ./tools/deploy.py \
    ./configs/mmseg/segmentation_tensorrt-fp16_dynamic-512x1024-2048x2048.py \
    ./mmsegmentation/configs/segmenter/segmenter_vit-l_mask_8x1_512x512_160k_ade20k.py \
    ./mmsegmentation/checkpoints/segmenter_vit-l_mask_8x1_512x512_160k_ade20k_20220105_162750-7ef345be.pth \
    ./mmsegmentation/demo/demo.png \
    --work-dir work_dir\
    --device cuda\
    --dump-in

[RunningLeon]

512x512 @haofanwang Try with static config with 512x512. You can change in config file.

[eliabruni]

maskformer mmdet tensorrt

[isbrycee]

swin-transformer mmdet onnx

[Siannodel]

Swin-Transformer mmcls tensorrt

[shannanyinxiang]

SATRN mmocr tensorrt

[awesome01010]

SATRN for ocr, to onnx and tensorrt pls!

[summerlvsong]

SATRN for ocr, to onnx and tensorrt pls!

[Mountchicken]

SATRN MMOCR tensorrt

[Xiangxu-0103]

dynamic_voxelization mmdet3d onnxruntime and tensorrt

[YongboLiang]

Swin-Transformer Second Segmenter

[hust-lidelong]

Oriented R-CNN，S2A-Net for mmrotate tensorrt, please!

[eliabruni]

mask2former mmdet tensorrt

[jianghaijun007]

monoflex tensorrt

[gzxy-0102]

mmtracking

[troyliu0105]

AssociativeEmbedding pose detection in mmpose

[SpaceView]

mmocr

[rickvanveen]

yolact mmdetection onnx

[LeoRainly]

K-Net

[leemengwei]

htc

[s95huang]

Smoke, mmdetection3d , tensorrt

[manhtd98]

Swin-Transformer mmdetection tensorrt

[zhangzscn]

yolact mmdetection onnx

[manhtd98]

@VVsssssk do you know when swin-transformers can release

[Liuhongmiao]

a vote to TOOD

[baigwadood]

MMaction2/Pyskl for (skeleton based action recognition)

[wwcc1107]

deformable detr！，detr！，transformer系列

[lvhan028]

segmenter mmsegmentation tensorrt

Done. It's been supported in v0.6.0

[lvhan028]

Swin-Transformer mmdetection tensorrt

Done. It's been supported in v0.6.0

[DoubleChuang]

solov2 onnx tensorrt

[KooSung]

TSM/TSN... mmaction2 tensorrt

[oYAYAYo]

mmdetection3d SMOKE

[MaxeeCR]

TSM、Video swin-transformer mmaction2 tensorrt :heart_eyes: :pray:

[machine52vision]

mmdetection solov2

[421psh]

solov2 tensorrt

[FDInSky]

fcos3d in mmdetection3d

[elepherai]

solov2 tensorrt

[eliabruni]

@VVsssssk : Given that both MaskFormer and Mask2Former got lots of votes, is there any plan to support them? They are not even on the table on top, any specific reason? Thank you!

[KongCang]

solov2 onnx tensorrt

[kishcs]

SAR model

[kelvinwang139]

ConvNeXt

[awarebayes]

ConvNext mmdet tensorrt

[nikky4D]

HTC segmentation object detection, onnx tensorrt