-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### Ultralytics YOLO Component
Pred…
-
Your inference turned out to be much more accurate than Ultralytic's inference.
I found this interesting thing called DeepSparse. It works faster than ONNX but unfortunately its inference is less a…
kopyl updated
9 months ago
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
Hi, I am an engineer from Intel and I work mostly on the performance optimization of PyTorch on intel Xeon CPUs (also I am the pytorch module maintainer for cpu performance). Just come across this…
-
```
21/11/2022 07:29:41 PM [ INFO ] Running Nebullvm optimization on CPU
21/11/2022 07:29:43 PM [ WARNING ] Missing Frameworks: tensorflow.
Please install them to include them in the optimization …
-
Hi, great template, thanks for sharing. I also find these tools to be awesome. I'm looking forward to the medium article.
You should add deepsparse to improve CPU inference.
https://github.com/n…
-
**Describe the bug**
When exporting the YOLOv8s (pruned50-quant, model.pt from sparsezoo) model via the ONNX exporter (sparseml.ultralytics.export_onnx), its performance noticeably decreases compar…
-
**Describe the bug**
Hi Dr @clementpoiret! Now that you have graduated :tada: here is a technical issue to keep you busy :wink:
On a workstation with AVX512 and VNNI CPU capabilities, I am gett…
-
The legacy text-generation pipeline supported trust_remote_code as an argument, which was inherited from the Transformers base pipeline here: https://github.com/neuralmagic/deepsparse/blob/491302a5135…
mgoin updated
7 months ago
-
### The Feature
Could you add support for Deepspare server (see: [github](https://github.com/neuralmagic/deepsparse))? The implementation of their Quantized Pruned seems promising (see:
[sparsezoo]…