alibaba / EasyNLP

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
Apache License 2.0
2.03k stars 250 forks source link

where are you selecting for layers 4-14 in Freeprompt #365

Open yaseryacoob opened 3 weeks ago

yaseryacoob commented 3 weeks ago

The paper discusses the selection of layers 4-14 of Self attention in the copying. I can't seem to find where in the code it is actually done. It appears to em that the 16 layers are being copied?

Also, is it possible to share the code for the Ablation in Figure 10 in the paper?

Many thanks.