search

AndriyMulyar / semantic-text-similarity

an easy-to-use interface to fine-tuned BERT models for computing semantic similarity in clinical and web text. that's it.
MIT License
215 stars 51 forks source link

Loading of WebBertSimilarity model breaks #3

Closed abmehta closed 4 years ago

abmehta commented 5 years ago

Hello,

While using this repo, I noticed that the web-bert-similarity model fails to load. After some digging, I realized that the authors of hugging-face/pytorch-transformers have released a new version i.e. 1.2.0 resulting in your code breaking at line 27 of /models/bert/similarity.py. I was able to fix it by enforcing the older version of pytorch-transformers (1.1.0) and thought that I should give you heads up about the same in case you weren't aware.

Thanks and good luck!

AndriyMulyar commented 4 years ago

Thank you!

AndriyMulyar commented 4 years ago

I have applied to the fix to the master branch and package release. Thank you again.

asiftandel96 commented 2 years ago

I am unable to load web bert similarity model Can you please help @AndriyMulyar

File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\site-packages\flask\app.py", line 2091, in call return self.wsgi_app(environ, start_response) File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\site-packages\flask\app.py", line 2076, in wsgi_app response = self.handle_exception(e) File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\site-packages\flask_cors\extension.py", line 165, in wrapped_function return cors_after_request(app.make_response(f(*args, kwargs))) File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\site-packages\flask\app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\site-packages\flask\app.py", line 1518, in full_dispatch_request rv = self.handle_user_exception(e) File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\site-packages\flask_cors\extension.py", line 165, in wrapped_function return cors_after_request(app.make_response(f(args, kwargs))) File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\site-packages\flask\app.py", line 1516, in full_dispatch_request rv = self.dispatch_request() File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\site-packages\flask\app.py", line 1502, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(req.view_args) File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\site-packages\flask_cors\decorator.py", line 128, in wrapped_function resp = make_response(f(args, kwargs)) File "D:\NLP Projects\semantic-text-similarity\clientApp.py", line 34, in predictRoute webert_prediction = webbert_object.predict() File "D:\NLP Projects\semantic-text-similarity\web_bert.py", line 10, in predict model = WebBertSimilarity(device='cpu', batch_size=10) File "D:\NLP Projects\semantic-text-similarity\semantic_text_similarity\models\bert\web_similarity.py", line 7, in init model_path = get_model_path(model_name) File "D:\NLP Projects\semantic-text-similarity\semantic_text_similarity\models\util.py", line 40, in get_model_path raise exc File "D:\NLP Projects\semantic-text-similarity\semantic_text_similarity\models\util.py", line 36, in get_model_path tar = tarfile.open(temp_file.name) File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\tarfile.py", line 1573, in open return func(name, "r", fileobj, **kwargs) File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\tarfile.py", line 1638, in gzopen fileobj = gzip.GzipFile(name, mode + "b", compresslevel, fileobj) File "C:\Users\Asif\anaconda3\envs\semantic-text-similarity\lib\gzip.py", line 163, in init fileobj = self.myfileobj = builtins.open(filename, mode or 'rb') PermissionError: [Errno 13] Permission denied: 'C:\Users\Asif\AppData\Local\Temp\tmppi0i4vlj'