search

princeton-vl / SEA-RAFT

[ECCV2024 - Oral, Best Paper Award Candidate] SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow
BSD 3-Clause "New" or "Revised" License
327 stars 11 forks source link

SEA-RAFT L Checkpoints & Zero-Shot Validation #9

Closed ChristophReich1996 closed 3 months ago

ChristophReich1996 commented 3 months ago

Hi, great work again! Are the SEA-RAFT large checkpoints just the medium checkpoints with more refinement iterations? Additionally, I do not fully understand the zero-shot validation approach. In the paper, you are stating that you are downsampling the 1080p images of Kitti by a factor of two and upsample the optical flow again. However, the Kitti images have a resolution different than 1080p (typically 376 x 1241 pixels, but the size varies). Do you crop before downsampling, or do you use the original resolution (probably padded to accommodate the required backbone stride of 8)? Thanks again for the help :)

MemorySlices commented 3 months ago

SEA-RAFT(L) and SEA-RAFT(M) share the same weights. For Spring zero-shot evaluation, we use downsample-upsample strategy as mentioned in the papers. For KITTI and Sintel zero-shot eval, we use full-resolution images as the input without cropping.

ChristophReich1996 commented 3 months ago

Thanks for the clarification; cheers, Christoph!