search

chaiNNer-org / chaiNNer

A node-based image processing GUI aimed at making chaining image processing tasks easy and customizable. Born as an AI upscaling application, chaiNNer has grown into an extremely flexible and powerful programmatic image processing application.
https://chaiNNer.app
GNU General Public License v3.0
4.44k stars 278 forks source link

Object detection. #1626

Open reedHam opened 1 year ago

reedHam commented 1 year ago

Hi, I am looking to take a video split it into frames. Then for each frame, use an object detection model like https://github.com/facebookresearch/detectron2. The resulting inferences can also be used for things like tracking, auto cropping or stabilization.

For example. Using the resulting inference I want to crop the original frame so that only the detected bounding box (or some threshold around it) remains. Then combine the cropped images into separate videos for each detected entity.

Is this supported by chaiNNer?

joeyballentine commented 1 year ago

This is not currently supported. Maybe at some point in the future we could implement that though, but probably not any time soon