How to attach transformer adapter for efficient fine-tuning?

open-mmlab / mmsegmentation

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

https://mmsegmentation.readthedocs.io/en/main/

Apache License 2.0

8.29k stars 2.62k forks source link

Open daeunni opened 1 year ago

daeunni commented 1 year ago

Hi, thanks for your nice work. :)

how can I attach the transformer adapter to the mmsegmentation for efficient fine-tuning? I wanna attach it to the Segformer MiT encoder.

Can anyone help me? TT

MengzhangLI commented 1 year ago

Use can see ViT-Adapter, whose downstream semantic segmentation task is verified using MMSegmentation.