when I executed this script in folder Model-Reference/PyTorch/nlp/bert/data, it failed:
]# bash create_datasets_from_start.sh
Checkout WikiExtractor repository
fatal: destination path 'wikiextractor' already exists and is not an empty directory.
Download dataset wiki_only
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 16: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 17: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 18: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 19: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 21: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 22: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 23: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 24: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 25: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 26: import: command not found
/home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 28: syntax error near unexpected token (' /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 28:def main(args):'
when I executed this script in folder Model-Reference/PyTorch/nlp/bert/data, it failed: ]# bash create_datasets_from_start.sh Checkout WikiExtractor repository fatal: destination path 'wikiextractor' already exists and is not an empty directory. Download dataset wiki_only /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 16: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 17: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 18: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 19: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 21: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 22: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 23: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 24: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 25: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 26: import: command not found /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 28: syntax error near unexpected token
(' /home/fred/habana/Model-References/PyTorch/nlp/bert/data/bertPrep.py: line 28:
def main(args):'