RidgeRun / gst-inference

A GStreamer Deep Learning Inference Framework
GNU Lesser General Public License v2.1
119 stars 29 forks source link

How to feed buffer to deep model in gsreamer plugin #327

Open PythonImageDeveloper opened 3 years ago

PythonImageDeveloper commented 3 years ago

Hi everyone, Suppose I want to use python inference for a deep model and do inference in plugin, one solution is to copy all regular inference python codes in do_transform_ip method in the class of gstreamer plugin, and convert buffer to numpy array and then pass to the model and get inference and create metadata for that buffer and then pass metadata to next element, but I don't know is it optimal solution convert buffer to numpy array for feeding the model? I want to know, in the c++ gstinfer element, the buffer converted to numpy array before feed to model? Is it possible to feed buffer to model? I want to know converting buffer to numpy array is has overload? I know converting buffer to numpy array in prob_function has overload, but I don't know has overload in the inside plugin overload also?