search

SafeAILab / EAGLE

Official Implementation of EAGLE
https://arxiv.org/pdf/2406.16858
Apache License 2.0
622 stars 59 forks source link

Why does instruction_len need to subtract 2? #77

Closed cdliang11 closed 3 weeks ago

cdliang11 commented 1 month ago

https://github.com/SafeAILab/EAGLE/blob/667ba930db7ea0075421f3c7df94ffbc10b93805/eagle/ge_data/ge_data_all_llama2chat.py#L114-L115

For the llama3 model, does instruction_len also need to subtract 2?

cdliang11 commented 3 weeks ago

done