search

hkust-nlp / deita

Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
Apache License 2.0
458 stars 28 forks source link

[question] repr_filter encoding only the instruction or instruction and anwser? #9

Closed Force1ess closed 7 months ago

Force1ess commented 7 months ago

thank u for your patience

VPeterV commented 7 months ago

Hi! As we mentioned here: https://github.com/hkust-nlp/deita/issues/8#issuecomment-1892996694

We encode the sentence with instruction + answer