Closed abdoelsayed2016 closed 1 year ago
i fixed it and it works i forgot to add load_dir but it worked only one time after i tired to run it again i got this error the new command is
python run_demo_edit.py --run_mode eval_request --index_port 51997 --test_path $DATA_DIR/open-qa/squad/test_preprocessed.json --eval_batch_size 64 --save_pred --truecase --cuda --index_name start/1048576_flat_OPQ96 --dump_dir $SAVE_DIR/densephrases-multi_wiki-20181220/dump/ --load_dir princeton-nlp/densephrases-multi-query-multi --max_answer_length 50
could anyone please help me to fixed this error
File "run_demo_edit.py", line 45, in __init__
self.query_encoder, self.tokenizer, _ = load_encoder(self.device, args, query_only=True)
File "..../....../.../DensePhrases/densephrases/utils/single_utils.py", line 95, in load_encoder
model = load_class(
File "...../.../..../.conda/envs/densephrases-v1.1.0/lib/python3.8/site-packages/transformers/modeling_utils.py", line 1294, in from_pretrained
raise EnvironmentError(
OSError: Error no file named ['pytorch_model.bin', 'tf_model.h5', 'model.ckpt.index', 'flax_model.msgpack'] found in directory princeton-nlp/densephrases-multi-query-multi or `from_tf` and `from_flax` set to False.
i figure out the problem but i dont know how to solve it i tired different model from https://huggingface.co/princeton-nlp it is works for first time but when i run the code again it gave the error above
File "run_demo_edit.py", line 45, in __init__
self.query_encoder, self.tokenizer, _ = load_encoder(self.device, args, query_only=True)
File "..../....../.../DensePhrases/densephrases/utils/single_utils.py", line 95, in load_encoder
model = load_class(
File "...../.../..../.conda/envs/densephrases-v1.1.0/lib/python3.8/site-packages/transformers/modeling_utils.py", line 1294, in from_pretrained
raise EnvironmentError(
OSError: Error no file named ['pytorch_model.bin', 'tf_model.h5', 'model.ckpt.index', 'flax_model.msgpack'] found in directory princeton-nlp/densephrases-multi-query-multi or `from_tf` and `from_flax` set to False.
i fixed it by downloading the models from hugging face
Hello
thank you for you sharing code but i have question becuase the results of Nq-open and squad have error when i tested them
i changed the code of run demo to make evaultion for the test dataset without using server and using this commad line
the code work fine but the result is very bad i dont know what the reason
and i notice that the prediction is only one word here is an example of the predication and true label
some time give one character
here is my edit code