ljzycmd / SimDeblur

Simple framework for image and video deblurring, implemented by PyTorch
MIT License
306 stars 38 forks source link

Comparison of results #17

Open txy00001 opened 7 months ago

txy00001 commented 7 months ago

Hello, I have three questions I would like to consult, 1. After trying some models, I feel that the effect of video deblurring is not very good, are there any improvement measures? 2. Can't reason about your own video directly? I want to enter a video path directly? 3. Compare the deblurring effect of nafnet and the source code in the framework, I feel that the effect of the source code is much better than the effect in the framework, have you done a test comparison?

ljzycmd commented 7 months ago

Hi @txy00001, regarding your questions:

  1. The deblurring results are highly restricted in real-world scenarios since these models are trained with synthetic datasets. You can refer to the paper https://arxiv.org/abs/2208.13184 for the analysis.
  2. I will add such an inference demo ASAP.
  3. For the models integrated into this framework, I have tested them with their open-sourced checkpoints and obtained the same evaluation metrics on the same dataset. However, I have not checked the visual results. By the way, are the checkpoints used for inference the same?
txy00001 commented 7 months ago

嗨,关于您的问题:

  1. 去模糊结果在实际场景中受到高度限制,因为这些模型是使用合成数据集训练的。您可以参考论文 https://arxiv.org/abs/2208.13184 进行分析。
  2. 我将尽快添加这样的推理演示。
  3. 对于集成到此框架中的模型,我使用开源检查点对其进行了测试,并在同一数据集上获得了相同的评估指标。但是,我没有检查视觉结果。顺便问一下,用于推理的检查点是一样的吗?

The checkpoints are different, the official checkpoints I used, compared the effect of the checkpoints in the frame, the effect of the checkpoints in the frame is poor, and I look forward to using my own video for reasoning as soon as possible

txy00001 commented 7 months ago

You can try the REDS/NAFNet-width64.yml in the following source code, I use this as a checkpoint for comparison, maybe you can try, of course you can also modify the model based on the video, output the model for the video, so that the framework will be more useful