microsoft / BlingFire

A lightning fast Finite State machine and REgular expression manipulation library.
MIT License
1.84k stars 129 forks source link

[Bug] Input/Output Error compiling linguistic sources into automata on Mac #121

Open gowthamrang-ds opened 3 years ago

gowthamrang-ds commented 3 years ago

Hello experts, I am trying to compile blingfire wbd tokenizer (latest release) on Mac following https://github.com/Microsoft/BlingFire/wiki/How-to-change-linguistic-resources I am encountering an “Input/Output error” when trying to execute make -f Makefile.gnu lang=wbd all

fa_build_conf \
     --in=wbd_chuni/ldb.conf.small \
     --out=wbd_chuni/tmp/ldb.mmap.small.txt
fa_fsm2fsm_pack --type=mmap \
     --in=wbd_chuni/tmp/ldb.mmap.small.txt \
     --out=wbd_chuni/tmp/ldb.conf.small.dump \
     --auto-test
fa_build_lex --dict-root=. --full-unicode --in=wbd_chuni/wbd.lex.utf8 \
     --tagset=wbd_chuni/wbd.tagset.txt --out-fsa=wbd_chuni/tmp/wbd.rules.fsa.txt \
     --out-fsa-iwmap=wbd_chuni/tmp/wbd.rules.fsa.iwmap.txt \
     --out-map=wbd_chuni/tmp/wbd.rules.map.txt
Assigning non-zero to $[ is no longer possible at fa_preproc_mLJyysye line 2.
Assigning non-zero to $[ is no longer possible at fa_preproc_phTqt8Iv line 2.
Assigning non-zero to $[ is no longer possible at fa_preproc_Ou_JVTIV line 2.
ERROR: Input/Output error. in /Users/Gowtham.Raman/Desktop/document-vectorization/BlingFire/blingfirecompile.library/src/FAAutIOTools.cpp at line 47 in program fa_fsm2fsm_iwec
ERROR: Input/Output error. in /Users/Gowtham.Raman/Desktop/document-vectorization/BlingFire/blingfirecompile.library/src/FAAutIOTools.cpp at line 313 in program fa_nfa2dfa
ERROR: Input/Output error. in /Users/Gowtham.Raman/Desktop/document-vectorization/BlingFire/blingfirecompile.library/src/FAAutIOTools.cpp at line 84 in program fa_fsm2fsm
fa_fsm2fsm_pack --alg=triv --type=moore-dfa --remap-iws --use-iwia --in=wbd_chuni/tmp/wbd.rules.fsa.txt --iw-map=wbd_chuni/tmp/wbd.rules.fsa.iwmap.txt --out=wbd_chuni/tmp/wbd.fsa.small.dump
ERROR: Input/Output error. in /Users/Gowtham.Raman/Desktop/document-vectorization/BlingFire/blingfirecompile.library/src/FAAutIOTools.cpp at line 449 in program fa_fsm2fsm_pack
make: *** [wbd_chuni/tmp/wbd.fsa.small.dump] Error 2

Can someone help me understand whats happening ? :)

gowthamrang-ds commented 3 years ago
brew install perl@5.18
echo 'export PATH="/usr/local/opt/perl@5.18/bin:$PATH"' >> ~/.zshrc