SforAiDl / Playground

A python library consisting of pipelines for visual analysis of different sports using Computer Vision and Deep Learning.
MIT License
18 stars 17 forks source link

Highlights Generation in Cricket #88

Open ashwinvaswani opened 4 years ago

ashwinvaswani commented 4 years ago

A good starting point would be to use the intensity (pitch / something else) of audio from commentary to filter out "exciting events" and compile the clips from those events to generate highlight.

ashwinvaswani commented 4 years ago

Can also look at this: https://github.com/immuno121/Automatic-highlight-generation-from-Sports-Videos

veds12 commented 4 years ago

I would like to take this up

veds12 commented 4 years ago

The model in the link you provided does not incorporate audio information so might not be the best suitable approach. I found a paper which suggests the use of semantic concept mining and incrporates both audio and visual data:

sci-hub.tw/10.1007/s11042-009-0337-1

Can you take a look at this and see if we can use this

Rijul1999 commented 4 years ago

Yeah we can definitely use that imo, looks like really good work. However implementing the network might be difficult if we start from that. I think we should first build something simple, like in this article https://www.analyticsvidhya.com/blog/2019/09/guide-automatic-highlight-generation-python-without-machine-learning/, and then slowly improve it to the network in the paper. Once we have something of a base which works, imo it will be easier for us to improve on it later on.

veds12 commented 4 years ago

Ya makes sense. I'll start implementing what's given in the link

veds12 commented 4 years ago

I have implemented this. Should I open a PR if this approach is going to be incorporated in the library?

ashwinvaswani commented 4 years ago

Yes put up a PR

veds12 commented 4 years ago

Is there any need for enhancement right now or can the issue be closed?

Rijul1999 commented 4 years ago

I think let's keep it open for now. We are aiming to add the enhancements ultimately after all.

ashwinvaswani commented 4 years ago

@Rijul1999 Basic implementation is done. Check on additional work in this