livepeer / verification-classifier

Metrics-based Verification Classifier
MIT License
8 stars 7 forks source link

Experiment with quantization step for random frame sampling #104

Closed yondonfu closed 4 years ago

yondonfu commented 4 years ago

One suggestion that has been made for handling different frame rates in the source and rendition is sampling timestamps instead of frame numbers comparing coincident frames in the source and rendition (occurring at the same timestamp). This would require adding a quantization step to grab coincident frames in the source and rendition. The downside of this approach is that when either upsampling or downsampling s.t. the rendition FPS is not a divisor of the source FPS, not all of the rendition frames will be eligible for sampling. However, given these two cases are not very common, it could be useful to experiment with this approach to confirm that it at least addresses the common case of downsampling where the rendition FPS is a divisor of the source FPS (i.e. 60fps -> 30fps).

yondonfu commented 4 years ago

Closed by #111 - ended up using a different solution based on PTS comparisons between the source and rendition.