uzh-rpg / rpg_timelens

Repository relating to the CVPR21 paper TimeLens: Event-based Video Frame Interpolation
597 stars 86 forks source link

Difficulty in interpreting timelens video output #20

Open Rishabh-Samra opened 3 years ago

Rishabh-Samra commented 3 years ago

So I used your uploaded notebook TimeLens.ipynb for interpolating video frames. So I gave input 595 images in the format specified and was expecting output as interpolated image frames. I didn't understand how you calculated inserts using the formula mentioned as for my case, np.diff(timestamps).mean() is coming to be 10^7(why numerator for calculating fps has a value of 10^6?). Since I was expecting 10 inserts, I manually specified that value. Also I had done two sets of experiments where I have taken target_fps =600 and 1000

After running the timelens cell, I got as an output around 6545 image frames and two videos namely input.mp4(duration=200 sec) and interpolation.mp4(220 sec). After running the final cell using ffmpeg command, I also got output as a video: timelens.mp4(260 sec). Another doubt is for both value of target_fps I am getting the same videos as output and also number of interpolation frames were same. So for our case is it correct to say input fps=2.7(595/220) and output fps = 25(6545/260)?

I am finding difficult to interpret the output of the above mentioned 3 videos and 4th video that I can form after combining output images at my custom fps. Say if I am looking for generating 600 fps video, I will get a video of duration 10 sec from output video. Please help me out to interpret the above mentioned 4 videos of the output too.