tokenize-anything.sh with no reaction

redpony / cdec

Decoder, aligner, and model optimizer for statistical machine translation and other structured prediction models based on (mostly) context-free formalisms

http://cdec-decoder.org/

Apache License 2.0

183 stars 77 forks source link

tokenize-anything.sh with no reaction #52

Closed andidol closed 9 years ago

andidol commented 9 years ago

cdec/corpus/tokenize-anything.sh script does nothing when executing it on a corpus file. It just lags and doesn't execute

./tokenize-anything.sh corpus.de > corpus.de.tok

andidol commented 9 years ago

ok got it...

./tokenize-anything.sh < corpus.de > corpus.de.tok

redpony commented 9 years ago

I added an error message so that if you run the script with command line arguments it indicates how it should be run.