Better video timeline segmentation template/support.

[RafayAK]

Is your feature request related to a problem? Please describe. The current video timeline segmentation template is deficient in a number of very important features, which result in annotations that are hard to control and an overall poor user experience.

Describe the solution you'd like Most of the above features I'm listing are supported by tools such as VGG VIA or Vidat.

To name a few, the template could do with the following features:

• support videos without audio
• the ability to automatically detect the FPS of a video without the need to explicitly specify in the template configs
• the ability to jump between temporal segments
• the ability to increase/decrease the extent of the left or right edge of a selected temporal segment for fine-grained annotation
• the ability to play/pause a video while being locked to the segment boundary.
• the ability to reduce playback speed below 0.5 and above 2.5 and control it on the fly with keyboard shortcuts
• the ability to seek either the start or end of a temporal segment while annotating.

Describe alternatives you've considered

Video timeline segmentation is a very specific use case. It is akin to annotating all frames in a video that has an event of note, for example, a part of the video where it's raining or snowing, this use case does not translate well to object-detection or tracking templates as alluded here nor does adding a silent track to potentially thousands of videos a viable solution.

[makseq]

@RafayAK Have you tried to use <Video> tag instead? Does it satisfy the most of your criterias?

[RafayAK]

@makseq I don't really understand your suggestion, how can I incorporate <Video> tag in the below template?

<View>
  <Header value="Video timeline segmentation via AudioPlus sync trick"/>
  <Video name="video" value="$video_url" sync="audio"/>
  <Labels name="tricks" toName="audio" choice="multiple">

  <Label value="activity" background="#1b5100"/></Labels>
  <AudioPlus name="audio" value="$video_url" sync="video" speed="false"/>
</View><!--
  Audio tag uses the same $video file to be in sync, video is muted
--><!--{
 "video_url": "/static/samples/opossum_snow.mp4"
}-->

[makseq]

I meant this template

<View>
   <Labels name="videoLabels" toName="video" allowEmpty="true">
     <Label value="Man" background="blue"/>
     <Label value="Woman" background="red"/>
     <Label value="Other" background="green"/>
   </Labels>

   <!-- Please specify FPS carefully, it will be used for all project videos -->
   <Video name="video" value="$video" framerate="25.0"/>
   <VideoRectangle name="box" toName="video" />
</View>

Yes, it has bboes, but you can use them as dummy things (put them randomly on the image).

[brandonbiggs]

Did anyone find a way to change the playback speed of videos?

[RafayAK]

Any updates on this?