ltkong218 / FastFlowNet

FastFlowNet: A Lightweight Network for Fast Optical Flow Estimation (ICRA 2021)
MIT License
259 stars 42 forks source link

使用pre-trained(things3d)模型,在MpiSintelClean_Training数据集上epe只有4.3,达不到论文中的水平 #24

Closed worhar closed 1 year ago

worhar commented 1 year ago

你好,我在复现您的算法时,发现精度只能达到题述水平,我确认以下几点和您的实现一致:

worhar commented 1 year ago

1、数据归一化 2、网络结构与权重 3、预测结果使用bilinear缩放,乘以20.0

ltkong218 commented 1 year ago

The EPE on MPI Sintel Clean of FastFlowNet pre-trained on FlyingThings3D is 2.89 in the paper, while you get the result of 4.3. I think the big difference may be the misconfigured PyTorch or correlation layer.

I suggest you change the running environment, such as PyTorch version and correlation version, to try it again.

Or you can train the model with the data augmentation code in MaskFlowNet to reproduce it.

worhar commented 1 year ago

是的,你的猜测是对的。是因为Pytorch版本的问题,高于1.3的版本grid_sample()中align_corners参数默认值发生了变化,导致了这一巨大的误差。