openvinotoolkit / openvino_notebooks

📚 Jupyter notebook tutorials for OpenVINO™
Apache License 2.0
2.47k stars 819 forks source link

【PaddlePaddle Hackathon 4】RFC of Task 205 Fighting Recognition Based on PaddleDetection #1016

Closed sususama closed 1 year ago

sususama commented 1 year ago

RFC of PaddlePaddle Hackathon 4 Task 205

Solution name:

Fighting Recognition Based on PaddleDetection

Description:

Train a fight recognition model based on the PaddleVideo video development kit, and then integrate the trained model into the PP Human of PaddleDetection. Use the pre trained PP-Human model for inference on the OpenVINO platform to detect fights in the video.

Workflow:

1681958661343

Models:

PP-Human, PaddleVideo

Results visualizing:

72

Project TimeLine:

4/18 Submitting RFC 4/22 Creating PR 5/7 Merging PR

My experience in ML and DL

950 is my PR

openvino-dev-samples commented 1 year ago

@sususama thanks for your proposals, but seems the video is lost, could you add more description on this use case ?

sususama commented 1 year ago

@sususama thanks for your proposals, but seems the video is lost, could you add more description on this use case ?

I converted it to gif format 72

openvino-dev-samples commented 1 year ago

Meanwhile the workflow is still not clear for me. Since paddledetection is like a toolbox including many kinds of models, could you identify more on which models you will implement and how to connect them together ?

sususama commented 1 year ago

Meanwhile the workflow is still not clear for me. Since paddledetection is like a toolbox including many kinds of models, could you identify more on which models you will implement and how to connect them together ?

I updated the Description and Workflow.

Description:

Train a fight recognition model based on the PaddleVideo video development kit, and then integrate the trained model into the PP Human of PaddleDetection. Use the pre trained PP-Human model for inference on the OpenVINO platform to detect fights in the video.

Workflow:

1681958661343

sususama commented 1 year ago

Hi @OpenVINO-dev-contest, there is a paragraph in the description of the activity:

In the second stage, we will select 2 excellent solutions from the results submitted in the first stage, and invite corresponding developers to submit PR based on their own solutions.

When will the results of the two proposals selected in the second stage be announced?

openvino-dev-samples commented 1 year ago

Hi Actually the deadline of RFC submission is 4/15, but we still can accept some impressive notebook demo. From my perspective, I prefer to an industrial solution for all anomalous behavior detection including fighting, smoking, telephone call, and fall in a alert zone, or a template where user can switch their model to detect a different anomalous behavior. Btw, since we dont want to make our notebook's dependency too heavy, could you explain more on what's paddle video?

sususama commented 1 year ago

I'm quoting an explanation from PaddleVideo's GitHub homepage here:

PaddleVideo is a toolset for video recognition, action localization, and spatio temporal action detection tasks prepared for the industry and academia. This repository provides examples and best practice guildelines for exploring deep learning algorithm in the scene of video area.

From my perspective, I prefer to an industrial solution for all anomalous behavior detection including fighting, smoking, telephone call, and fall in a alert zone, or a template where user can switch their model to detect a different anomalous behavior.

That is to say, I can train several models for different application scenarios, choose according to the needs of users, and even implement it in code: I only need to enter the type of my own requirements, and then select the corresponding model.

openvino-dev-samples commented 1 year ago

hi @sususama The pipeline is still unclear for me. I think you should add more detailed description on this flow chart. for example, PP-Human, PaddleVideo are the name of toolkit. and it includes more function and models. I don't know which modules from these toolkits will be implemented in this notebook, and how do you integrate them with your pipeline.