search

georgmartius / vid.stab

Video stabilization library
http://public.hronopik.de/vid.stab/
Other
842 stars 108 forks source link

Rolling shutter compensation? #63

Open AndyLeeRobinson opened 6 years ago

AndyLeeRobinson commented 6 years ago

Hi, I've used the deshaker plugin with VirdualDub for many years, and it can do a fairly good job of reducing rolling shutter distortion, both in lateral and vertical motion, but I don't see this ability with this plugin. If the camera moves laterally, the image is skewed, and if moved vertically then the image is either squashed or stretched. This also depends on each particular camera used, so would need to analyse markers on the corners of the frames to try to determine the amount of compensation required. Needless to say, this is complicated and I don't have the skills to be able to contribute! Even rolling shutter compensation can't remove higher frequency distortions such as jello from multicopter footage. If someone can crack that using a matrix to morph-compensate each frame for jello removal, they'd be a superstar!

adrium commented 5 years ago

That would be a very nice feature! For sunny outdoor scenes, the rolling shutter effect is less extreme. But otherwise, most other videos look distorted after stabilized...

btw, there is a nice paper about it using a neural network: https://apvijay.github.io/pdf/2017_cvpr.pdf

georgmartius commented 5 years ago

Cool. Sounds like a good idea.

andrixnet commented 5 years ago

I'm not sure how it is implemented, but here is some usage documentation explaining about it for the "deshaker" filter for VirtualDub: http://www.guthspot.se/video/deshaker.htm

andrixnet commented 4 years ago

I've worked with VirtualDub + deshaker a number of times and got some pretty good results. Since the rolling amount is guesswork for my devices, I did several trial-n-error runs to get the best footage.