styler00dollar / VapourSynth-RIFE-ncnn-Vulkan

RIFE filter for VapourSynth
MIT License
97 stars 22 forks source link

Bad(interlaced, overlayed like) inference output of `rife-4.5` and `rife-4.6` models #4

Closed Justin62628 closed 1 year ago

Justin62628 commented 1 year ago

Using the same script of inference implemented by nihui, the following models produce different outputs as followed: (uhd_mode = False and tta_mode = False)

There might be a problem with the quantitization or conversion of the ensemble feature. Would it be convenient for you to share the scripts for model conversions(pytorch model to ncnn .params & .bins)? Nihui says she converted the rife-v4 model using pnnx, which could make a difference I guess.

styler00dollar commented 1 year ago

I don't use pnnx. I use self written code and workarounds to export. The model itself won't change anyway, only the param file. Please test with my vapoursynth code again instead of nihui. It worked fine there iirc. I use different ncnn submodule, but I don't think that is it.

Justin62628 commented 1 year ago

uh you're right. lmao after some debug I found that using Intel GPU is the reason for that overlayed output. NVIDIA GPU works like a charm.