Remove BPE codes after translation.

facebookresearch / XLM

PyTorch original implementation of Cross-lingual Language Model Pretraining.

Other

2.87k stars 495 forks source link

Remove BPE codes after translation. #306

Open abdullahkhilji opened 4 years ago

abdullahkhilji commented 4 years ago

Is there a way to remove BPE codes from generated sentences after running translate.py for translation or is there any other way to get the sentences translated?

saikoneru commented 4 years ago

In the output sentences replace("@@ ","")