执行:
python training_sup_text_matching_model_jsonl_data.py --model_arch cosent --do_train --do_predict --num_epochs 4 --model_name nghuyong/ernie-3.0-base-zh --output_dir ./outputs/STS-cosent
报错信息:pyo3_runtime.PanicException: no entry found for key
具体:
thread '' panicked at 'no entry found for key', C:\Users\builder\AppData\Local\Temp\pip-req-build-hhcj09m8\tokenizers-lib\src\models\mod.rs:36:66
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace
Epoch: 0%| | 0/4 [03:41<?, ?it/s]
Traceback (most recent call last):
File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples\training_sup_text_matching_model_jsonl_data.py", line 132, in
main()
File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples\training_sup_text_matching_model_jsonl_data.py", line 82, in main
model.train_model(
File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples..\text2vec\cosent_model.py", line 111, in train_model
global_step, training_details = self.train(
File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples..\text2vec\cosent_model.py", line 303, in train
self.save_model(output_dir, model=self.bert, results=results)
File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples..\text2vec\sentence_model.py", line 277, in save_model
self.tokenizer.save_pretrained(output_dir)
File "C:\Users\hayden\anaconda3\lib\site-packages\transformers\tokenization_utils_base.py", line 2246, in save_pretrained
save_files = self._save_pretrained(
File "C:\Users\hayden\anaconda3\lib\site-packages\transformers\tokenization_utils_fast.py", line 622, in _save_pretrained
self.backend_tokenizer.save(tokenizer_file)
pyo3_runtime.PanicException: no entry found for key
执行: python training_sup_text_matching_model_jsonl_data.py --model_arch cosent --do_train --do_predict --num_epochs 4 --model_name nghuyong/ernie-3.0-base-zh --output_dir ./outputs/STS-cosent 报错信息:pyo3_runtime.PanicException: no entry found for key 具体: thread '' panicked at 'no entry found for key', C:\Users\builder\AppData\Local\Temp\pip-req-build-hhcj09m8\tokenizers-lib\src\models\mod.rs:36:66
note: run with
main()
File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples\training_sup_text_matching_model_jsonl_data.py", line 82, in main
model.train_model(
File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples..\text2vec\cosent_model.py", line 111, in train_model
global_step, training_details = self.train(
File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples..\text2vec\cosent_model.py", line 303, in train
self.save_model(output_dir, model=self.bert, results=results)
File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples..\text2vec\sentence_model.py", line 277, in save_model
self.tokenizer.save_pretrained(output_dir)
File "C:\Users\hayden\anaconda3\lib\site-packages\transformers\tokenization_utils_base.py", line 2246, in save_pretrained
save_files = self._save_pretrained(
File "C:\Users\hayden\anaconda3\lib\site-packages\transformers\tokenization_utils_fast.py", line 622, in _save_pretrained
self.backend_tokenizer.save(tokenizer_file)
pyo3_runtime.PanicException: no entry found for key
RUST_BACKTRACE=1
environment variable to display a backtrace Epoch: 0%| | 0/4 [03:41<?, ?it/s] Traceback (most recent call last): File "C:\Users\hayden\downloads\text2vec-master_1\text2vec-master\examples\training_sup_text_matching_model_jsonl_data.py", line 132, in