Closed ztw33 closed 3 years ago
You need to run the prepare.sh script. Since binarization has not been done, there is no data-bin
folder.
The java
directory should look as follows.
.
|-train.spm.java
|-valid.jsonl
|-train.spm.en_XX
|-test.spm.java
|-test.spm.en_XX
|-valid.spm.java
|-valid.spm.en_XX
|-test.jsonl
|-train.jsonl
|-data-bin
| |-train.java-en_XX.java.idx
| |-valid.java-en_XX.en_XX.bin
| |-preprocess.log
| |-train.java-en_XX.en_XX.bin
| |-valid.java-en_XX.java.idx
| |-valid.java-en_XX.en_XX.idx
| |-dict.java.txt
| |-train.java-en_XX.en_XX.idx
| |-test.java-en_XX.en_XX.idx
| |-train.java-en_XX.java.bin
| |-test.java-en_XX.en_XX.bin
| |-dict.en_XX.txt
| |-test.java-en_XX.java.idx
| |-valid.java-en_XX.java.bin
| |-test.java-en_XX.java.bin
In the prepare.sh
script, this function should be executed. Please delete the data-bin
directory and re-run the prepare.sh
script.
The
java
directory should look as follows.. |-train.spm.java |-valid.jsonl |-train.spm.en_XX |-test.spm.java |-test.spm.en_XX |-valid.spm.java |-valid.spm.en_XX |-test.jsonl |-train.jsonl |-data-bin | |-train.java-en_XX.java.idx | |-valid.java-en_XX.en_XX.bin | |-preprocess.log | |-train.java-en_XX.en_XX.bin | |-valid.java-en_XX.java.idx | |-valid.java-en_XX.en_XX.idx | |-dict.java.txt | |-train.java-en_XX.en_XX.idx | |-test.java-en_XX.en_XX.idx | |-train.java-en_XX.java.bin | |-test.java-en_XX.en_XX.bin | |-dict.en_XX.txt | |-test.java-en_XX.java.idx | |-valid.java-en_XX.java.bin | |-test.java-en_XX.java.bin
In the
prepare.sh
script, this function should be executed. Please delete thedata-bin
directory and re-run theprepare.sh
script.
Thanks a lot! I have successfully run the training scripts. Thanks again for your patience!
Hi, I want to train code-to-text model using pretrained model. I download the file
code-to-text.zip
, after I executebash prepare.sh
, the files indata/codeXglue/code-to-text/java
are listed as below:When I execute
bash run.sh 0 java
, I gotFileNotFoundError: Dataset not found: valid (/home/.../PLBART/data/codeXglue/code-to-text/java/data-bin)
andFileNotFoundError: Dataset not found: test (/home/.../PLBART/data/codeXglue/code-to-text/java/data-bin)
error. May I please ask whether I forget some steps? Which files are supposed to be indata/codeXglue/code-to-text/java
? Sorry if I bother, I appreciate your help!