search

pillargg / pillar_algos

Finds best timestamps to cut at
https://docs.pillar.gg/pillar_algos/
GNU General Public License v3.0
1 stars 0 forks source link

Ideas list for ways to improve clips #33

Open RusseII opened 3 years ago

RusseII commented 3 years ago

Let's use this issue to talk about all possible ways we can improve clips. None of these ways needs tackled right away but will be useful down the line.

So far:

  1. Use laughter detection algorithm to get timestamps of laughter (audio only)
  2. Look for silent moments using an audio level detector (audio only)
  3. Document screenshots per game type of what would make a good moment (game ended screen in hearthstone for example) run something to find where there were frames in the video similar to the screenshot and use that to ajust clips. (video)
pomkos commented 3 years ago

Use of sudden loud sounds (peaks) in audio.

@kjv13 @chand1012

Sentiment analysis in chat, extract excitement.

Sentiment analysis in VOD for same reason.