feinanshan / M2M_VFI

Many-to-many Splatting for Efficient Video Frame Interpolation
Other
79 stars 5 forks source link

JFE output feature channels number #3

Closed Eric-chuan closed 2 years ago

Eric-chuan commented 2 years ago

Hi, well done on your new paper. Can I ask you the channels number of each JFE's output respectively. Or where can I find the supplementary material of the paper to learn about more details of your awesome work.

feinanshan commented 2 years ago

Hi. The output channels for JEFs are 32, 64, 128, and 256 respectively. We are hoping to finish the internal check soon and release the codes.

Eric-chuan commented 2 years ago

As you mentioned in your paper, each JFE module has a two-layer downsampling CNN. The inputs of them are the original feature and the warped feature, then I get the input channels and output cnannels as follows:

feinanshan commented 2 years ago

Hi, the legal check is longer than I expected. The input/output for JFEs is like the following.

Eric-chuan commented 2 years ago

Okay, thank you for your warm answer. Do you have an expected date for the code release?

feinanshan commented 2 years ago

We are trying to work it out before July, but no guarantee for that.

Eric-chuan commented 2 years ago

Get it, thank you so much

Eric-chuan commented 2 years ago

Hi, I have reproduced a version of the M2MModel based on your instructions. currently I am using only laplacian loss for training and have not added the LFM module and can get a PSNR of 34.8 on Vimeo90k. but there is a problem, I find that the estimated multiple optical flows are sparse (looks like a bunch of spots), can you provide any helpful advice? thanks image

feinanshan commented 2 years ago

Hi, codes are released.