search

blakeblackshear / frigate

NVR with realtime local object detection for IP cameras
https://frigate.video
MIT License
18.23k stars 1.66k forks source link

Use the DeepStack interface to use yolo-models #11462

Closed hoeflechner closed 4 months ago

hoeflechner commented 4 months ago

not a request I already have a solution, see below

Describe what you are trying to accomplish and why in non technical terms I want to be able to use yolo-models running on my gpu so that I can perform fast and good detection

Describe the solution you'd like a DeepStack-like service that is decoupled from frigate

Describe alternatives you've considered converting yolo models to tensorrt oder onnx

Additional context as mentioned here:

Originally posted by @alexyao2015 in https://github.com/blakeblackshear/frigate/issues/10717#issuecomment-2025386192

i hacked together a minimal deepstack-like service that uses yolo world. it can read frigates config and can detect objects mentioned there.

https://github.com/hoeflechner/yolostack

NickM-27 commented 4 months ago

Frigate has built in support for deepstack / codeproject ai https://docs.frigate.video/configuration/object_detectors#deepstack--codeprojectai-server-detector

hoeflechner commented 4 months ago

thanks for your reply.

i know that deepstack support is build in. i used this deepstack support to call a service that implemets yoloworld (https://github.com/hoeflechner/yolostack)

so this is not a feature request but an anouncement for those who want to use yolo with frigate but i was not able to respond to https://github.com/blakeblackshear/frigate/pull/10717#issuecomment-2025386192

jsapede commented 3 months ago

Is openVINO hardware accélération possible with yolostack ?

hoeflechner commented 3 months ago

It is currently not supported. But I can look into it.

jsapede commented 3 months ago

And would it be available also for facial récognition ?

hoeflechner commented 3 months ago

It currently only uses yolo world. I have not looked into facial recognition yet (and no idea how to integrate that with frigate...

jsapede commented 3 months ago

Double-take makes this using frigate api deepstack api or compreface api and mqtt interaction but all thèse application only use NVIDIA hardware as accélération.

It works, but the inférence speed we gain with openVINO hardware for détection is destroyed by the CPU Time consummed by deepstack or compreface only running on CPU

Immich has machine learnig options with facial récognition accélérated by openVINO also and its quite efficient and available to api also maybe

hoeflechner commented 1 month ago

Is openVINO hardware accélération possible with yolostack ?

i think managed to make openvino and onnx work