search

dotnet / machinelearning

ML.NET is an open source and cross-platform machine learning framework for .NET.
https://dot.net/ml
MIT License
8.98k stars 1.88k forks source link

Does ml.net add a pipeline similar to nvidia deepstream? #5728

Open ChengYen-Tang opened 3 years ago

ChengYen-Tang commented 3 years ago

In real-time streaming image analysis, such as rtmp and rtsp, we use emgucv, opencvsharp... or other tools to pull the stream, and capture the image in it for object detection and object classification. Video stream -> GPU decoding -> CPU conversion image format -> ML.net GPU detection, and then returns the result -> C# statistics and drawing the box.

This process seems inefficient and the CPU usage is very high. If ML.net's pipelines can pull images -> detection -> drawing are all done on the GPU, it should greatly reduce the load.

michaelgsharp commented 3 years ago

Currently we don't have anything like that. We can look into a feature enhancement for it in the future though.