-
Hi!
Are there plans for making a low precision inference mode like many other neural network frameworks out there?
Would be really helpful for embedded applications where we have very limited memory…
-
Discussion: https://www.reddit.com/r/MachineLearning/comments/hu7lyt/p_yolov4tiny_speed_1770_fps_tensorrtbatch4/
Full structure: [structure of yolov4-tiny.cfg model](https://netron.app/?url=https:/…
-
There is a use_fp flag for the offline_quantize tool in saxml/tool to quantize the weight in fp8 but still has to be stored in int8(https://github.com/google/praxis/blob/3f4cbb4bcda366db7b018695fbe2d4…
-
Hi @jonnor
As mentioned in #102 , I'm going to write my specific`inference` based on `emlearn`.
Before start, I wrote a simple test according to `examples/classifiers.py`.
I tested the accuracy us…
-
* Forums: https://devtalk.nvidia.com/default/board/371/jetson-nano/
* Projects: https://developer.nvidia.com/embedded/community/jetson-projects
* Hello AI World: https://developer.nvidia.com/emb…
-
Is CUDA 12.1 support coming or in the works? Just curious since faster-whisper keeps looking for cublas11.dll...and although I don't use cudnn, I'm assuming that would be another aspect to consider? …
-
I correctly converted yolov7 from float32 to an int8 HEF and inference on hailo-8, but when I used the benchmark, I found that my model's FPS (28FPS) is only half of the official benchmark (46FPS).The…
-
I was working on #566
Found the problem in KeypointRCNN ([gist with stripped IR](https://gist.github.com/renxida/9a03340f9cd74b0f813e83245bf257e6#file-keypointrcnn_vaiq_int8-default-torch-onnx-str…
-
The [README](https://github.com/mlperf/inference_results_v0.5/blob/master/closed/DellEMC/code/ssd-small/openvino-linux/README.md) for SSD-Small using OpenVINO in the DellEMC submission, says:
> Run t…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…