Target FPS 7.5 to 30 - Githubissues

neu-vi / SportsSloMo

SportsSloMo: A New Benchmark and Baseline Models for Human-centric Video Frame Interpolation, CVPR 2024 (https://arxiv.org/abs/2308.16876)

https://neu-vi.github.io/SportsSlomo/

64 stars 3 forks source link

Target FPS 7.5 to 30 #3

Closed yjhong89 closed 12 months ago

yjhong89 commented 12 months ago

Hi! Thanks for sharing code and data.

What I want to do is to convert video of 7.5 fps to 30 fps.

Interpolate middle 3 frames given first and last frame. Then, what if I want to fine-tune with SportsSloMo dataset, what is the correct sampling for this?
In SportsSloMo they are converting from 30 fps to 240 fps (interpolate 7 frames)
Is it okay if sample frames [0, 4, 8, 12, 16] and [0,16] frames as input and predict [4,8,12] frames ?

playerkk commented 12 months ago

In the released data, we provide long sequences, which consist of continuous slow-motion content of a shot. So you should be able to use [0, 16] as input frames and estimate [4, 8, 12] intermediate ones.

yjhong89 commented 12 months ago

Thanks!