search

OpenGenus / vidsum

Generate summary of any video :tv: anywhere and anytime
GNU General Public License v3.0
259 stars 68 forks source link

Discussion: Video Summary #40

Open lwgray opened 6 years ago

lwgray commented 6 years ago

How can we improve the video summary? Can you provide url of videos that generate good summaries?

AdiChat commented 6 years ago

Keeping the basic approach same, we can improve the summary by generating summary of the subtitles using different text summarization algorithms depending upon the context of the video. For instance, in the case of group conversation, Cluster Rank algorithm is expected to give better results than LSA summarization algorithm. This is easily extensible in terms of implementation. 👍

Another approach, that I have been working on, is to split the video into frames and segment them into different scenes. For segmenting into different scenes, we can measure the similarity between two frames and a drop in similarity measure indicate change of scene. Thereby, we can measure similarity between scenes and choose few of them in a way that would give a general idea of the content.

Our current summarization algorithm gives decent result in case of this video 👍 In general, for any text for which we will get good results, a video with a text as subtitles will also produce good results.