Annbless / DUTCode

Pytorch implementation of DUT: Learning Video Stabilization by Simply Watching Unstable Videos
239 stars 36 forks source link

Why is the DUT output video cropped #23

Open lanono1 opened 1 year ago

lanono1 commented 1 year ago

Why is the DUT output video cropped,Is it because of the model?How should this problem be solved?

liutao23 commented 1 year ago

Why is the DUT output video cropped,Is it because of the model?How should this problem be solved?

You can output uncropped video frames in dutstabilizer.py's function to generate video, but this model will generate black boxes, so I recommend cropping the video. Black edge compensation, I saw the author share a boundary extrapolation method, but has not uploaded the project code, I think, you can try to use generative adversarial network to predict the boundary generation.

lanono1 commented 1 year ago

Thank you very much for your reply! I have one more question to ask. I set up the code environment according to the readme.file, but when I ran it, I got an error: RuntimeError: cuDNN error: CUDNN_STATUS_EXECUTION_FAILED。What is the reason for this problem?

liutao23 commented 1 year ago

Thank you very much for your reply! I have one more question to ask. I set up the code environment according to the readme.file, but when I ran it, I got an error: RuntimeError: cuDNN error: CUDNN_STATUS_EXECUTION_FAILED。What is the reason for this problem?

I guess it may be caused by the mismatch between your cuda and pytorch. Are you running code on Ubuntu? I haven't tried this before? Because I was configured and successfully run under the Windows 10 environment. Can you show me your conda list or pip list ,so that I can find the diffrence between your configuration and mine?

lanono1 commented 1 year ago

Thank you for reminding me! Now I also debug code in the windows environment. After investigation, I found that it was caused by insufficient video memory,Maybe I need to change the size of batchsize. Do you know how to modify the batchsize in dut?In addition, I wonder if it is convenient for you to leave your email address so that I can consult you more conveniently.

liutao23 commented 1 year ago

Thank you for reminding me! Now I also debug code in the windows environment. After investigation, I found that it was caused by insufficient video memory,Maybe I need to change the size of batchsize. Do you know how to modify the batchsize in dut?In addition, I wonder if it is convenient for you to leave your email address so that I can consult you more conveniently.

hello,my email is liutao14@njust.edu.cn

liutao23 commented 1 year ago

Thank you for reminding me! Now I also debug code in the windows environment. After investigation, I found that it was caused by insufficient video memory,Maybe I need to change the size of batchsize. Do you know how to modify the batchsize in dut?In addition, I wonder if it is convenient for you to leave your email address so that I can consult you more conveniently.

you can reduce your length of input video,out of memory can be slolved.The batch size can adjusted in config.but I remember it is 1.

Jerry-bear commented 3 months ago

Thank you for reminding me! Now I also debug code in the windows environment. After investigation, I found that it was caused by insufficient video memory,Maybe I need to change the size of batchsize. Do you know how to modify the batchsize in dut?In addition, I wonder if it is convenient for you to leave your email address so that I can consult you more conveniently.

you can reduce your length of input video,out of memory can be slolved.The batch size can adjusted in config.but I remember it is 1.

Do you have any code for evaluation metrics?