HazyResearch / deepdive

DeepDive
deepdive.stanford.edu
1.95k stars 543 forks source link

Can't run 'do sentences' in spouse example #664

Open prakashmishra1598 opened 6 years ago

prakashmishra1598 commented 6 years ago

I get the following error while running 'do sentences' while using v0.8.x:

‘run/RUNNING’ -> ‘20180102/144348.236896357’ ‘run/LATEST’ -> ‘20180102/144348.236896357’ 2018-01-02 14:43:51.099501 # on machine-learning-experimental-2: deepdive do sentences 2018-01-02 14:43:51.101989 # run/20180102/144348.236896357/plan.sh 2018-01-02 14:43:51.103923 # execution plan for data/sentences 2018-01-02 14:43:51.104013 2018-01-02 14:43:51.104036 : ## process/init/app ########################################################## 2018-01-02 14:43:51.104278 : # Done: 2017-12-30T11:10:56+0000 (3d 3h 32m 52s ago) 2018-01-02 14:43:51.104308 : process/init/app/run.sh 2018-01-02 14:43:51.104544 : mark_done process/init/app 2018-01-02 14:43:51.104581 : ############################################################################## 2018-01-02 14:43:51.104603 2018-01-02 14:43:51.104624 2018-01-02 14:43:51.104644 : ## process/init/relation/articles ############################################ 2018-01-02 14:43:51.104664 : # Done: 2018-01-02T13:09:27+0000 (1h 34m 21s ago) 2018-01-02 14:43:51.104684 : process/init/relation/articles/run.sh 2018-01-02 14:43:51.104704 : mark_done process/init/relation/articles 2018-01-02 14:43:51.104853 : ############################################################################## 2018-01-02 14:43:51.104891 2018-01-02 14:43:51.104916 2018-01-02 14:43:51.104941 : ## data/articles ############################################################# 2018-01-02 14:43:51.104964 : # Done: 2018-01-02T13:09:27+0000 (1h 34m 21s ago) 2018-01-02 14:43:51.104987 : # no-op 2018-01-02 14:43:51.105006 : mark_done data/articles 2018-01-02 14:43:51.105024 : ############################################################################## 2018-01-02 14:43:51.105041 2018-01-02 14:43:51.105059 2018-01-02 14:43:51.105076 ## process/ext_sentences_by_nlp_markup ####################################### 2018-01-02 14:43:51.105093 # Done: 2017-12-30T11:10:56+0000 (3d 3h 32m 52s ago) 2018-01-02 14:43:51.105110 process/ext_sentences_by_nlp_markup/run.sh 2018-01-02 14:43:51.105127 ++ dirname process/ext_sentences_by_nlp_markup/run.sh 2018-01-02 14:43:51.105145 + cd process/ext_sentences_by_nlp_markup 2018-01-02 14:43:51.105162 + export DEEPDIVE_CURRENT_PROCESS_NAME=process/ext_sentences_by_nlp_markup 2018-01-02 14:43:51.105181 + DEEPDIVE_CURRENT_PROCESS_NAME=process/ext_sentences_by_nlp_markup 2018-01-02 14:43:51.105199 + export DEEPDIVE_LOAD_FORMAT=tsv 2018-01-02 14:43:51.105216 + DEEPDIVE_LOAD_FORMAT=tsv 2018-01-02 14:43:51.105233 + deepdive compute execute 'input_sql= SELECT R0.id AS "articles.R0.id", R0.content AS "articles.R0.content" 2018-01-02 14:43:51.105251 FROM articles R0 2018-01-02 14:43:51.105274
2018-01-02 14:43:51.105289 ' 'command="$DEEPDIVE_APP"/udf/nlp_markup.sh' output_relation=sentences 2018-01-02 14:43:51.105311 Executing with the following configuration: 2018-01-02 14:43:51.105329 DEEPDIVE_NUM_PROCESSES=3 2018-01-02 14:43:51.105346 DEEPDIVE_NUM_PARALLEL_UNLOADS=1 2018-01-02 14:43:51.105363 DEEPDIVE_NUM_PARALLEL_LOADS=1 2018-01-02 14:43:51.105380 output_relation_tmp=dd_tmp_sentences 2018-01-02 14:43:51.105397 2018-01-02 14:43:51.374845 CREATE TABLE 2018-01-02 14:43:51.672068 CREATE TABLE 2018-01-02 14:43:51.783679 unloading to feed_processes-1: ' SELECT R0.id AS "articles.R0.id", R0.content AS "articles.R0.content" 2018-01-02 14:43:51.783834 FROM articles R0 2018-01-02 14:43:51.783868
2018-01-02 14:43:51.783890 ' 2018-01-02 14:43:51.792792 /home/ubuntu/spouse/udf/nlp_markup.sh: line 22: /home/ubuntu/spouse/udf/bazaar/parser/run.sh: No such file or directory 2018-01-02 14:43:51.793296 /home/ubuntu/spouse/udf/nlp_markup.sh: line 22: /home/ubuntu/spouse/udf/bazaar/parser/run.sh: No such file or directory 2018-01-02 14:43:51.802787 /home/ubuntu/spouse/udf/nlp_markup.sh: line 22: /home/ubuntu/spouse/udf/bazaar/parser/run.sh: No such file or directory 2018-01-02 14:43:51.849967 Loading dd_tmp_sentences from output_computed-1 (tsv format) unloading: 0:00:00 110 [1.06k/s] ([1.06k/s])

2018-01-02 14:43:51.924416 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 140: kill: (5670) - No such process unloading: 0:00:00 476KiB [ 4.4MiB/s] ([ 4.4MiB/s]) 0 /s])s])r/local/compute-execute: line 140: kill: (5684) - No such process 2018-01-02 14:43:51.934183 [ERROR] command='"$DEEPDIVE_APP"/udf/nlp_markup.sh': PID 5670: finished with non-zero exit status (0) 2018-01-02 14:43:51.934369 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 138: 5671 Terminated DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < process-$i.input > process-$i.output 2018-01-02 14:43:51.934407 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 138: 5672 Terminated DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < process-$i.input > process-$i.output 2018-01-02 14:43:51.934427 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 138: 5676 Terminated mkmimo process-.output > output_computed- 2018-01-02 14:43:51.934445 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 138: 5677 Terminated deepdive-load "$output_relation_tmp" output_computed- 2018-01-02 14:43:51.935923 /home/ubuntu/local/util/compute-driver/local/compute-execute: line 1: 5683 Terminated deepdive-db unload "$input_sql" "$DEEPDIVE_LOAD_FORMAT" feed_processes- 2018-01-02 14:43:51.976486 COPY 0 ‘run/ABORTED’ -> ‘20180102/144348.236896357’

MahmoudYounes commented 6 years ago

can you check if home/ubuntu/spouse/udf/nlp_markup.sh exists? if it does not, copy it from the examples/spouse/udf folder to yours