Could you tell me the complete training process of side tuning?
According to my understanding, your training process should be divided into the following stages:
the pretraining of the base model
the distillation of the side model
training of the transfer part
But the training script of the side model is not provided in the code repository? I don't know if there is a problem with my understanding of the article. Could you explain it to me?
Could you tell me the complete training process of side tuning? According to my understanding, your training process should be divided into the following stages:
But the training script of the side model is not provided in the code repository? I don't know if there is a problem with my understanding of the article. Could you explain it to me?