search

kwonmha / bert-vocab-builder

Builds wordpiece(subword) vocabulary compatible for Google Research's BERT
226 stars 47 forks source link

Windows fatal exception: access violation #10

Closed frank-lin-liu closed 4 years ago

frank-lin-liu commented 4 years ago

I run subword_builder.py in the Windows 7 system and have the error message below. Could you please let me know what the problem is?

Windows fatal exception: access violation

Current thread 0x00002078 (most recent call first): File "D:\Anaconda3\lib\site-packages\tensorflow\python\lib\io\file_io.py", lin e 384 in get_matching_files_v2 File "D:\Anaconda3\lib\site-packages\tensorflow\python\lib\io\file_io.py", lin e 363 in get_matching_files File "F:\BERT\bert-vocab-builder-master\tokenizer.py", line 133 in _read_filep attern File "F:\BERT\bert-vocab-builder-master\tokenizer.py", line 188 in corpus_toke n_counts File "subword_builder.py", line 63 in main File "D:\Anaconda3\lib\site-packages\absl\app.py", line 250 in _run_main File "D:\Anaconda3\lib\site-packages\absl\app.py", line 299 in run File "D:\Anaconda3\lib\site-packages\tensorflow\python\platform\app.py", line 40 in run File "subword_builder.py", line 81 in