Closed syspider closed 3 months ago
Thank you for the remarkable work!
In all the 3 training stages, are the whole model parameters updated ? Or in stage 1, only the linear projection updated ?
Looking forward to your reply.
Hi! Thanks for your interest in our work. Yes all parameters are fine-tuned in three stages of pre-training and instruction fine-tuning.
Thank you for the remarkable work!
In all the 3 training stages, are the whole model parameters updated ? Or in stage 1, only the linear projection updated ?
Looking forward to your reply.