czczup / ViT-Adapter

[ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictions
https://arxiv.org/abs/2205.08534
Apache License 2.0
1.27k stars 140 forks source link

knowledge distillation #143

Open GitHubYuxiao opened 1 year ago

GitHubYuxiao commented 1 year ago

Your project is so good.If I want to use knowledge distillation to teach your ViT-Adapter-S model to learn the human semantic segmentation effect of ViT-Adapter-L, what should I be mindful of.

lianzheng-research commented 1 year ago

I have the same question. Need some help~