Question about freezing LM parameter problem

snap-stanford / GreaseLM

[ICLR 2022 spotlight]GreaseLM: Graph REASoning Enhanced Language Models for Question Answering

MIT License

228 stars 40 forks source link

Question about freezing LM parameter problem #7

Open lokking opened 2 years ago

lokking commented 2 years ago

Hi, I'am very interesting in this model. I want to know why freeze LM parameters previous epochs. In my knowledge, LM parameters are fun-tuned in previous epochs(1~3) and then freeze it. I would really appreciate for your help.