-
**Is your feature request related to a problem? Please describe.**
As Data Scientist/Developer,
I want to deploy a model that requires nodes with specific flags and hardware.(e.g. https://github.c…
-
Hi,
Quantization is not available in the UI, could you provide an approximate ETA? is there a recommended course of action for performing pruning with UI and quantization by other means?
Thanks!
-
Hi, I test yolov5s model in ubuntu 16.04 but the speed is very slow as below figure. It warns that VNNI instructions not detected, quantization speedup not well supported. What't the problem and how s…
-
Hello,
I have trained several pruned models and saved the weights (using other pruning methods) and converted the saved models to onnx (using torch). I'm interested in comparing their inference time…
-
Hi, I tried to run the following codes and it seems that it could run smoothly on my mac/terminal, but always died if I run in jupyter notebook:
```
from sparseml.pytorch.models import ModelRegistry…
-
**Describe the bug**
Trying to run the server-client example.
**Environment**
Include all relevant environment information:
Ubuntu 18.04
2. Python version : 3.8
3. Other Python package versi…
-
While I was installing sparsify on Windows 10, via cmd using the command 'pip install sparsify' I encountered some errors :
![error_sparsify](https://user-images.githubusercontent.com/52241581/126708…
-
What is the maximum expected acceleration from Deepsparse? (Assuming that the model is sparsified further with sparseml as well)
In the documentation here, achieving GPU-level performance on CPUs i…
-
Hi, after uploading and analyzing a onnx model with sparsify, it gives the following message.
The onnx model is correct (checked by the onnx checker) and can be used by other software.
![image](h…
-
Great contribution.
It would be better if deepsparse could support ARM devices.