search

zhuchen03 / FreeLB

Adversarial Training for Natural Language Understanding
250 stars 41 forks source link

Errors generated during data preprocessing #17

Closed yupeijei1997 closed 3 years ago

yupeijei1997 commented 3 years ago

hi,

When i execute this command source ./examples/roberta/preprocess_GLUE_tasks.sh glue_data ALL, the following error is generated.

  File "/root/FreeLB/fairseq-RoBERTa/fairseq_cli/preprocess.py", line 2
    ../preprocess.py
    ^
SyntaxError: invalid syntax

https://github.com/zhuchen03/FreeLB/blob/master/fairseq-RoBERTa/fairseq_cli/preprocess.py#L1

I don't understand why this script is written like this （ ../preprocess.py）

But after finishing the data processing, I can run run_glue.sh successfully.

so what is the purpose of this script？

Hope to get your answer, thanks.

zhuchen03 commented 3 years ago

Hi,

Most of the code in this repo comes from fairseq and I did not write this data preprocessing script. It is actually a symbolic link, not a python file, as in previous fairseq releases: https://github.com/pytorch/fairseq/tree/v0.6.2

yupeijei1997 commented 3 years ago

Thanks for your answer！