when I running the prepro.py, it is terminating at spm.SentencePieceTrainer.Train(train).And I get no any information. Has anyone encountered this problem? how to deal with it?
INFO:root:# Train a joint BPE model with sentencepiece
Process finished with exit code 139 (interrupted by signal 11: SIGSEGV)
bobobe
commented
2 years ago
when I running the prepro.py, it is terminating at spm.SentencePieceTrainer.Train(train).And I get no any information. Has anyone encountered this problem? how to deal with it?
INFO:root:# Train a joint BPE model with sentencepiece
Process finished with exit code 139 (interrupted by signal 11: SIGSEGV)