TanBinh93 / Structure-from-Motion-based-on-Dense-Optical-Flow-method

Homologous point groups (point tracks) determination usable as the input of Structure from Motion (SfM).
3 stars 2 forks source link

Is there any way to improve the process speed? #1

Closed TakiOrange closed 3 years ago

TakiOrange commented 3 years ago

Hi! Thank you for sharing the code.

I have successfully run the sample code with the default 4 images but it almost took me 40 mins. I understand that dense optical flow is very time consuming, but since the complexity will improve greatly with more images, I wonder whether this speed is within expectation. If not, is there any key to improve the process speed?

I'm using Matlab R2021a with i7-9700K processor, GeForce RTX 3070.

Besides, through the sample code, I saved the extracted HP groups, and I would like to use them as the input of COLMAP. I checked the guidance mentioned in the Readme.txt, and if you could share the script to transform the point track to the COLMAP feature format, it will help improve the usability. Thank you again.

TanBinh93 commented 3 years ago

Hi,

Thank you for your interesting question. I haven't worked on that project since last year. The dense optical flow computation took a long time as you can see. We also had a C++ version for this dense optical flow method developed by my former colleague.

Now, my former team is working to improve the speed of optical flow computation by rewriting the code in C++ and integrated it with GPU. The new version will also be released in the near future. It is a full pipeline for 3D reconstruction.

How to transform the point track to the COLMAP feature format is in the link below: https://colmap.github.io/tutorial.html#feature-detection-and-extraction (see Feature Detection and Extraction part). Next time, I will check the code and update the script to convert the point track into COLMAP.

Thank you and best regards, Binh

On Thu, Aug 26, 2021 at 4:48 PM TakiOrange @.***> wrote:

Hi! Thank you for sharing the code.

I have successfully run the sample code with the default 4 images but it almost took me 40 mins. I understand that dense optical flow is very time consuming, but since the complexity will improve greatly with more images, I wonder whether this speed is within expectation. If not, is there any key to improve the process speed?

I'm using Matlab R2021a with i7-9700K processor, GeForce RTX 3070.

Besides, through the sample code, I saved the extracted HP groups, and I would like to use them as the input of COLMAP. I checked the guidance mentioned in the Readme.txt, and if you could share the script to transform the point track to the COLMAP feature format, it will help improve the usability. Thank you again.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/TanBinh93/Structure-from-Motion-based-on-Dense-Optical-Flow-method/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIH2DDJKU6YEDIL46GQGVJDT6ZH2NANCNFSM5C3RARIQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email .

TakiOrange commented 3 years ago

Thank you for the quick reply!

Integrating it with GPU sounds quite interesting, and I believe it will make the computation much quicker. I'm looking forward to trying the new version in the near future.

Thank you and your team again for the effort!

TanBinh93 commented 3 years ago

You're welcome. Thank you!

On Fri, Aug 27, 2021 at 3:36 PM TakiOrange @.***> wrote:

Thank you for the quick reply!

Integrating it with GPU sounds quite interesting, and I believe it will make the computation much quicker. I'm looking forward to trying the new version in the near future.

Thank you and your team again for the effort!

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/TanBinh93/Structure-from-Motion-based-on-Dense-Optical-Flow-method/issues/1#issuecomment-907208491, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIH2DDLL5CDEPFPZWN7RFSLT66IFHANCNFSM5C3RARIQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.