search

autogluon / autogluon

Fast and Accurate ML in 3 Lines of Code
https://auto.gluon.ai/
Apache License 2.0
7.59k stars 897 forks source link

How to use Conv-Lora in other domains ，for example vit? #4165

Open STSTERANDMOMO opened 4 months ago

STSTERANDMOMO commented 4 months ago

I want to get the bottom level code about how to construct Conv-Lora ,so that I can use it in my research.

Harry-zzh commented 2 months ago

Hi, you could refer to https://github.com/autogluon/autogluon/blob/master/multimodal/src/autogluon/multimodal/models/adaptation_layers.py#L606, https://github.com/autogluon/autogluon/blob/master/multimodal/src/autogluon/multimodal/models/sam.py, https://github.com/autogluon/autogluon/blob/master/multimodal/src/autogluon/multimodal/optimization/lit_semantic_seg.py for further details.