Closed yapingzhao closed 5 years ago
I found the same question. You get the answer? Please help me
@kingkf It is generally done when the source and target languages are from the same alphabet. Please refer to the original bpe paper, which has a nice discussion on joint-bpe vs independent-bpe (section 3.2)
Hi, I have a question about BPE: When I use wmt16_en_de.sh file to generate BPE vocab, why is the source language and the target language mixed?Thank you. Looking forward to your advice or answers. Best regards,
yapingzhao