-
### System Info
Running docker image version 2.4.0 with eetq quantization
Model: microsoft/Phi-3.5-mini-instruct
```
{"model_id":"microsoft/Phi-3.5-mini-instruct","model_sha":"af0dfb8029e8a7454…
-
# **AI-Powered Image Processing for Monitoring Counter Services**
AI system will analyze real-time CCTV footage to detect various events such as customer congestion, idle counters, long waiting times…
-
Hi all,
I exported a generic (and trained) Yolov8n model into tflite format and loaded in a react native app (no expo).
After I have understood the output format, I have been trying to execute a…
-
I have converted the checkpoint to frozen graph, now I want to inference the frozen graph at real time on GPU instead of Android. Kindly share the inference script for the same.
Thanks.
-
Hi, thank you for the awesome work! I would like to ask what is the inference time of it? Can it achieve real-time performance?
-
### Describe the proposed feature and its relevance to inferencing
Add IREE and Godot Engine demos
### Context or use case
How can we should the world IREE and Godot Engine is cool.
### Pr…
-
1.Can faster methods be used for feature extraction, and currently, a single batch of feature extraction can only be done at 15fps?
2.Can we obtain 3D joint positions in the Integrate features stag…
-
-
Assuming that we use [clearml-serving](https://github.com/allegroai/clearml-serving) real time inferencing, we may need to spin our own dynamic loading/unloading algorithm the reason is that the core …
-
Hi Mohit,
Thanks for providing this pre-trained model.
I have a few questions on this:
1) Is there a way to run this model on GPU for inference?
2) Can we utilize these model weights to do real…