Open bwang482 opened 4 years ago
ls -lh total 148K drwxrwxr-x 5 bowang bowang 4.0K Nov 20 18:10 configs drwxrwxr-x 3 bowang bowang 4.0K Nov 20 18:21 data -rw-rw-r-- 1 bowang bowang 506 Nov 20 18:10 data_config.py -rw-rw-r-- 1 bowang bowang 12K Nov 20 18:10 data_loader.py -rw-rw-r-- 1 bowang bowang 4.6K Nov 20 18:10 demo.py -rw-rw-r-- 1 bowang bowang 3.8K Nov 20 18:10 demo_utils.py drwxrwxr-x 3 bowang bowang 4.0K Nov 20 18:10 dstc -rw-rw-r-- 1 bowang bowang 203 Nov 20 18:10 env.py drwxrwxr-x 3 bowang bowang 4.0K Nov 20 18:21 gpt2_training -rw-rw-r-- 1 bowang bowang 1.2K Nov 20 18:10 LICENSE -rw-rw-r-- 1 bowang bowang 1.5K Nov 20 18:10 LSP-generic.yml -rw-rw-r-- 1 bowang bowang 2.0K Nov 20 18:10 LSP-linux.yml drwxrwxr-x 3 bowang bowang 4.0K Nov 20 18:21 lsp_model -rw-rw-r-- 1 bowang bowang 15K Nov 20 18:10 LSP_train.py -rw-rw-r-- 1 bowang bowang 16 Nov 20 18:10 MANIFEST.in drwxrwxr-x 4 bowang bowang 4.0K Nov 20 18:21 models -rw-rw-r-- 1 bowang bowang 3.7K Nov 20 19:07 output.log -rw-rw-r-- 1 bowang bowang 7.1K Nov 20 18:10 prepro.py drwxrwxr-x 2 bowang bowang 4.0K Nov 20 18:21 pycache drwxrwxr-x 8 bowang bowang 4.0K Nov 20 18:21 pycocoevalcap -rw-rw-r-- 1 bowang bowang 29K Nov 20 18:10 README.md drwxrwxr-x 6 bowang bowang 4.0K Nov 20 18:10 reddit_extractor -rw-rw-r-- 1 bowang bowang 2.4K Nov 20 18:10 SECURITY.md
It looks like prepro.py failed during running, can you share with us under which folder do you run the command, and print what are under folder "data"? Thanks!
I'm facing the same problem, but there are required files under the folder "data". Any ideas?
I'm facing the same problem, but there are required files under the folder "data". Any ideas?
Can you print what is listed under "data" folder? Thanks!
I'm facing the same problem, but there are required files under the folder "data". Any ideas?
Can you print what is listed under "data" folder? Thanks!
-rw-rw-r--. 1 387872 Nov 25 11:05 dummy_data.tsv -rw-rw-r--. 1 71 Nov 25 11:05 prepare4db.sh drwxrwxr-x. 2 4096 Nov 25 14:14 train.128len.db -rw-rw-r--. 1 387872 Nov 25 11:05 train_raw.tsv -rw-rw-r--. 1 467873 Dec 9 10:58 train.tsv
I'm facing the same problem, but there are required files under the folder "data". Any ideas?
Can you print what is listed under "data" folder? Thanks!
-rw-rw-r--. 1 387872 Nov 25 11:05 dummy_data.tsv -rw-rw-r--. 1 71 Nov 25 11:05 prepare4db.sh drwxrwxr-x. 2 4096 Nov 25 14:14 train.128len.db -rw-rw-r--. 1 387872 Nov 25 11:05 train_raw.tsv -rw-rw-r--. 1 467873 Dec 9 10:58 train.tsv
were you running the cmd under the project home folder, i.e., 'your_download_path/DialoGPT/'? It seems there is a relative path issue if you run demo.py under other folders cause it simply is a bunch of bash cmds. We will fix it in next few days.
I'm facing the same problem, but there are required files under the folder "data". Any ideas?
Can you print what is listed under "data" folder? Thanks!
-rw-rw-r--. 1 387872 Nov 25 11:05 dummy_data.tsv -rw-rw-r--. 1 71 Nov 25 11:05 prepare4db.sh drwxrwxr-x. 2 4096 Nov 25 14:14 train.128len.db -rw-rw-r--. 1 387872 Nov 25 11:05 train_raw.tsv -rw-rw-r--. 1 467873 Dec 9 10:58 train.tsv
I just edited demo.py so it will not have relative path problem, or at least print some informative messages for debugging purpose. can you pull and see if it works?
btw I check it on my side it worked on any running directory. But let me know if you still have any questions or problems.
I'm facing the same problem, but there are required files under the folder "data". Any ideas?
Can you print what is listed under "data" folder? Thanks!
-rw-rw-r--. 1 387872 Nov 25 11:05 dummy_data.tsv -rw-rw-r--. 1 71 Nov 25 11:05 prepare4db.sh drwxrwxr-x. 2 4096 Nov 25 14:14 train.128len.db -rw-rw-r--. 1 387872 Nov 25 11:05 train_raw.tsv -rw-rw-r--. 1 467873 Dec 9 10:58 train.tsv
I just edited demo.py so it will not have relative path problem, or at least print some informative messages for debugging purpose. can you pull and see if it works?
btw I check it on my side it worked on any running directory. But let me know if you still have any questions or problems.
I have tried new version, and got the following bug, error occurred, b'gzip: ./train.tsv.gz: No such file or directory\n' It seems that the data file is missing, how can I get it ? Thanks for help.
I'm facing the same problem, but there are required files under the folder "data". Any ideas?
Can you print what is listed under "data" folder? Thanks!
-rw-rw-r--. 1 387872 Nov 25 11:05 dummy_data.tsv -rw-rw-r--. 1 71 Nov 25 11:05 prepare4db.sh drwxrwxr-x. 2 4096 Nov 25 14:14 train.128len.db -rw-rw-r--. 1 387872 Nov 25 11:05 train_raw.tsv -rw-rw-r--. 1 467873 Dec 9 10:58 train.tsv
I just edited demo.py so it will not have relative path problem, or at least print some informative messages for debugging purpose. can you pull and see if it works? btw I check it on my side it worked on any running directory. But let me know if you still have any questions or problems.
I have tried new version, and got the following bug, error occurred, b'gzip: ./train.tsv.gz: No such file or directory\n' It seems that the data file is missing, how can I get it ? Thanks for help.
Can you try to run the script by setting 'data' as 'dummy' and see if it works? Or run it simply by "python demo.py" and do not put in any other arguments.
I tried 'small' data and indeed the data file is missing. We will try to fix it.
I'm facing the same problem, but there are required files under the folder "data". Any ideas?
Can you print what is listed under "data" folder? Thanks!
-rw-rw-r--. 1 387872 Nov 25 11:05 dummy_data.tsv -rw-rw-r--. 1 71 Nov 25 11:05 prepare4db.sh drwxrwxr-x. 2 4096 Nov 25 14:14 train.128len.db -rw-rw-r--. 1 387872 Nov 25 11:05 train_raw.tsv -rw-rw-r--. 1 467873 Dec 9 10:58 train.tsv
I just edited demo.py so it will not have relative path problem, or at least print some informative messages for debugging purpose. can you pull and see if it works? btw I check it on my side it worked on any running directory. But let me know if you still have any questions or problems.
I have tried new version, and got the following bug, error occurred, b'gzip: ./train.tsv.gz: No such file or directory\n' It seems that the data file is missing, how can I get it ? Thanks for help.
Can you try to run the script by setting 'data' as 'dummy' and see if it works? Or run it simply by "python demo.py" and do not put in any other arguments.
I tried 'small' data and indeed the data file is missing. We will try to fix it.
Thanks! The other two commands work.
is this fixed? We are still facing issue in running python demo.py --data smal
Also on running make command directly in reddit_extractor, it returns the below output - SIZE=small make -j 8 output - make: Nothing to be done for 'all'.
I also encountered the same problem. However in my case, it was because of the corruption of the .db (in my case was train.128len.db).
I was realized later that I had interrupted the process while it was running demo.py and downloading the resources. When I tried to run it again, It didn't check for the integrity of the .db file and caused the error.
I solved the problem by removing the .db in the data folder and the downloaded model_path folder in the models folder (ex. small) and everything works again.
I am running on Ubuntu 18.04 with cuda 10. I have followed
Setup & Installation (TL;DR) - Train model with Conda Environment
.