google-research / pegasus

Apache License 2.0
1.59k stars 315 forks source link

how does fine tuning change the original transformer language model? #230

Open mishav78 opened 1 year ago

mishav78 commented 1 year ago

what exactly happens to the token relationships behind the scenes so that it knows how to paraphrase never before seen sentences? How does it get from training data I would like to go to the movies. The cinema seems like an ideal choice.

to be able to paraphrase a sentence like I would vote for this candidate for president.