-
Hi,
nice project, thanks! I'm just trying to replicate your setup for IWSLT'14. Did you change the variable `BPE_TOKENS` in fairseqs `prepare-iwslt14.sh` to 32k as mentioned in your paper?
Are …
-
Is there a way to remove BPE codes from generated sentences after running translate.py for translation or is there any other way to get the sentences translated?
-
Hello everyone, I get this error on the train command.
It says I have a tab somewhere in my data but I actually have none (beside the vocab.shared file generated).
```
[2024-08-18 23:44:26,900 IN…
-
Could you please share the bpe codes file?
Or could you please tell us how many bpe symbols you learn?
-
I have a few questions.
1. I have used the data in the folder [https://github.com/facebookresearch/CodeGen/tree/main/data/test_dataset](https://github.com/facebookresearch/CodeGen/tree/main/data/t…
-
I am facing this error
Applying BPE to valid and test files...
Loading vocabulary from /home/UnsupervisedMT/NMT/data/mono/vocab.en.1500 ...
Read 26726 words (93 unique) from vocabulary file.
Lo…
-
Hi, thanks for your generous to provide the pertained model, I tried to run it and it tells the following errors, may I ask how could I solve it? thanks :
Traceback (most recent call last):
Fil…
-
How to process our para data with the provided BPE codes. I ran the fastBPE tools, and got some problems. The privided BPE codes has two columns, fastBPE need three columns. Could you give some advice…
-
Hey, I'm coming again! When I do Step 3. Train SLTUnet Model, I moved required files in two folders in train.sh file and run train.sh. When the code run to loading pretrained model, I got a warning be…
-
- ** test these codes :**
`import fastBPE
bpe = fastBPE.fastBPE(codes_path, vocab_path)
bpe.apply(["Roasted barramundi fish", "Centrally managed over a client-server architecture"])
`
- ** get th…