search

thunlp / GEAR

Source code for ACL 2019 paper "GEAR: Graph-based Evidence Aggregating and Reasoning for Fact Verification"
MIT License
98 stars 25 forks source link

Session aborted when running feature extraction script #7

Closed p-null closed 4 years ago

p-null commented 4 years ago

Hi, this error occurs when I running any feature extractor script.

Here is the last few lines of output when I do bash test_extractor.sh 

...
7f8aa4cc4000-7f8aa4cc8000 rw-p 00000000 00:00 0
7f8aa4ccc000-7f8aa5782000 r-xp 00000000 07:0b 31286264                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libtorch_python.so
7f8aa5782000-7f8aa5981000 ---p 00ab6000 07:0b 31286264                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libtorch_python.so
7f8aa5981000-7f8aa5995000 r--p 00ab5000 07:0b 31286264                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libtorch_python.so
7f8aa5995000-7f8aa59b1000 rw-p 00ac9000 07:0b 31286264                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libtorch_python.so
7f8aa59b1000-7f8aa5a05000 rw-p 00000000 00:00 0
7f8aa5a05000-7f8aa5a71000 rw-p 00d72000 07:0b 31286264                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libtorch_python.so
7f8aa5a71000-7f8aa5a79000 r-xp 00000000 07:0b 31286262                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libshm.so
7f8aa5a79000-7f8aa5c78000 ---p 00008000 07:0b 31286262                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libshm.so
7f8aa5c78000-7f8aa5c79000 r--p 00007000 07:0b 31286262                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libshm.so
7f8aa5c79000-7f8aa5c7a000 rw-p 00008000 07:0b 31286262                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libshm.so
7f8aa5c7a000-7f8aa5c80000 rw-p 0000c000 07:0b 31286262                   /root/anaconda3/lib/python3.7/site-packages/torch/lib/libshm.so
7f8aa5c80000-7f8aa5c95000 r-xp 00000000 07:0b 3255664141                 /root/anaconda3/lib/python3.7/site-packages/torch/_C.cpython-37m-x86_64-linux-gnu.so
7f8aa5c95000-7f8aa5e94000 ---p 00015000 07:0b 3255664141                 /root/anaconda3/lib/python3.7/site-packages/torch/_C.cpython-37m-x86_64-linux-gnu.so
7f8aa5e94000-7f8aa5e95000 r--p 00014000 07:0b 3255664141                 /root/anaconda3/lib/python3.7/site-packages/torch/_C.cpython-37m-x86_64-linux-gnu.so
7f8aa5e95000-7f8aa5e96000 rw-p 00015000 07:0b 3255664141                 /root/anaconda3/lib/python3.7/site-packages/torch/_C.cpython-37m-x86_64-linux-gnu.so
7f8aa5e96000-7f8aa5e9d000 rw-p 00026000 07:0b 3255664141                 /root/anaconda3/lib/python3.7/site-packages/torch/_C.cpython-37m-x86_64-linux-gnu.so
7f8aa5e9d000-7f8aa5e9f000 r--p 00000000 07:0b 2192615613                 /root/anaconda3/lib/python3.7/lib-dynload/_queue.cpython-37m-x86_64-linux-gnu.so
7f8aa5e9f000-7f8aa5ea0000 r-xp 00002000 07:0b 2192615613                 /root/anaconda3/lib/python3.7/lib-dynload/_queue.cpython-37m-x86_64-linux-gnu.so
7f8aa5ea0000-7f8aa5ea1000 r--p 00003000 07:0b 2192615613                 /root/anaconda3/lib/python3.7/lib-dynload/_queue.cpython-37m-x86_64-linux-gnu.sotest_extractor.sh: line 8:  4114 Aborted                 (core dumped) CUDA_VISIBLE_DEVICES=0 python extractor.py --input_file ../data/gear/gear-test-set-0_001.tsv --output_file ../data/gear/gear-test-set-0_001-features.tsv --bert_model ../pretrained_models/BERT-Pair/ --do_lower_case --max_seq_length 128 --batch_size 512

Does anyone know what could cause such error?

Specs: 3 core cpu, 8 GB memory, Ubuntu 16.04, 1080Ti

jayzzhou-thu commented 4 years ago

@tingkai-zhang Hi, I run the code on a GPU server with 8 core CPU, 125GB memory, Ubuntu 16.04, 1080Ti. When I run test_extractor.sh, the process needs about 3.5G memory (while train_extractor.py may need more).

p-null commented 4 years ago

Thanks. I will try to run it again.