> [array([[-0.3380675 , 0.09602544]], dtype=float32)] << raw scores
Errors
[davei@daveiawsuseast2v3-c7a-4xlarge-0001 deepsparse-1.7.0]$ ./engine.py
Traceback (most recent call last):
File "./engine.py", line 7, in
compiled_model = Engine(model=zoo_stub, batch_size=1)
File "/home/davei/.local/lib/python3.6/site-packages/deepsparse/engine.py", line 184, in init
self._model_path = model_to_path(model)
File "/home/davei/.local/lib/python3.6/site-packages/deepsparse/utils/onnx.py", line 99, in model_to_path
model = Model(model)
File "/home/davei/.local/lib/python3.6/site-packages/sparsezoo/model/model.py", line 81, in init
files, path, url = self.initialize_model_from_stub(self.source)
File "/home/davei/.local/lib/python3.6/site-packages/sparsezoo/model/model.py", line 324, in initialize_model_from_stub
stub, valid_params=list(PARAM_DICT.keys())
File "/home/davei/.local/lib/python3.6/site-packages/sparsezoo/model/utils.py", line 98, in load_files_from_stub
force_token_refresh=force_token_refresh,
File "/home/davei/.local/lib/python3.6/site-packages/sparsezoo/utils/requests.py", line 120, in download_get_request
response.raise_for_status()
File "/home/davei/.local/lib/python3.6/site-packages/requests/models.py", line 960, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://api.neuralmagic.com/models/download/nlp/sentiment_analysis/obert-base/pytorch/huggingface/sst2/pruned90_quant-none
Additional context
Add any other context about the problem here. Also include any relevant files.
Describe the bug Example code attempts to download the pruned90_quant-none dataset. The webserver returns an HTTP 403 'Forbidden' error.
Expected behavior The data should download and the example code should execute against it.
Environment Include all relevant environment information:
f7245c8
]:To Reproduce Example code from your github README:
[davei@daveiawsuseast2v3-c7a-4xlarge-0001 deepsparse-1.7.0]$ cat engine.py
!/usr/bin/env python3
from deepsparse import Engine
download onnx, compile
zoo_stub = "zoo:nlp/sentiment_analysis/obert-base/pytorch/huggingface/sst2/pruned90_quant-none" compiled_model = Engine(model=zoo_stub, batch_size=1)
run inference (input is raw numpy tensors, output is raw scores)
inputs = compiled_model.generate_random_inputs() output = compiled_model(inputs) print(output)
> [array([[-0.3380675 , 0.09602544]], dtype=float32)] << raw scores
Errors [davei@daveiawsuseast2v3-c7a-4xlarge-0001 deepsparse-1.7.0]$ ./engine.py Traceback (most recent call last): File "./engine.py", line 7, in
compiled_model = Engine(model=zoo_stub, batch_size=1)
File "/home/davei/.local/lib/python3.6/site-packages/deepsparse/engine.py", line 184, in init
self._model_path = model_to_path(model)
File "/home/davei/.local/lib/python3.6/site-packages/deepsparse/utils/onnx.py", line 99, in model_to_path
model = Model(model)
File "/home/davei/.local/lib/python3.6/site-packages/sparsezoo/model/model.py", line 81, in init
files, path, url = self.initialize_model_from_stub(self.source)
File "/home/davei/.local/lib/python3.6/site-packages/sparsezoo/model/model.py", line 324, in initialize_model_from_stub
stub, valid_params=list(PARAM_DICT.keys())
File "/home/davei/.local/lib/python3.6/site-packages/sparsezoo/model/utils.py", line 98, in load_files_from_stub
force_token_refresh=force_token_refresh,
File "/home/davei/.local/lib/python3.6/site-packages/sparsezoo/utils/requests.py", line 120, in download_get_request
response.raise_for_status()
File "/home/davei/.local/lib/python3.6/site-packages/requests/models.py", line 960, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://api.neuralmagic.com/models/download/nlp/sentiment_analysis/obert-base/pytorch/huggingface/sst2/pruned90_quant-none
Additional context Add any other context about the problem here. Also include any relevant files.