search

ThorstenBux / artoolkitX_em_2d

2d tracking with emscripten
Other
0 stars 1 forks source link

Improving performances with mutlithreading #5

Open kalwalt opened 5 years ago

kalwalt commented 5 years ago

As we discovered that OpenCV and OpenCL with emscripten is problematic, at least for now, we should find alternatives as discussed in the PR #3, I found that OpenCv has this function parallel_for_ to to parallelize the code see the article/example Could be useful in ArtoolkitX.js ? Anyway OpenCV should be compiled with the options described in the article, Should be verified that can be done with emscripten...

ThorstenBux commented 5 years ago

Good idea, I’m writing on having web workers on ja side already which keeps the live webcam stream at 60 FPS so you would not see the ‘slow’ tracking. That looks promising

Get Outlook for iOShttps://aka.ms/o0ukef

From: Walter Perdan notifications@github.com Sent: Thursday, September 19, 2019 9:53:44 AM To: ThorstenBux/artoolkitX_em_2d artoolkitX_em_2d@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Subject: [ThorstenBux/artoolkitX_em_2d] Improving performances with mutlithreading (#5)

As we discovered that OpenCV and OpenCL with emscripten is problematic, at least for now, we should find alternatives as discussed in the PR #3https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FThorstenBux%2FartoolkitX_em_2d%2Fpull%2F3&data=02%7C01%7C%7Ce87b4bb706f040cf20e708d73c82ae18%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637044404264945928&sdata=WRCRJJ5r4qL0AZVDgElY4ODacFMgCVXpX%2B7v0MvO7Nc%3D&reserved=0, I found that OpenCv has this function parallelfor to to parallelize the code see the article/examplehttps://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.opencv.org%2Fmaster%2Fd7%2Fdff%2Ftutorial_how_to_use_OpenCV_parallel_for_.html&data=02%7C01%7C%7Ce87b4bb706f040cf20e708d73c82ae18%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637044404264955945&sdata=u%2FSDkN3oQ3jFYMumOXMavF5LueM1IbGPCasREYw8cJs%3D&reserved=0 Could be useful in ArtoolkitX.js ? Anyway OpenCV should be compiled with the options described in the article, Should be verified that can be done with emscripten...

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FThorstenBux%2FartoolkitX_em_2d%2Fissues%2F5%3Femail_source%3Dnotifications%26email_token%3DAD765PEU6XEADXZ2HMEOHXLQKKPORA5CNFSM4IYED3H2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HMIKKYA&data=02%7C01%7C%7Ce87b4bb706f040cf20e708d73c82ae18%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637044404264965950&sdata=VS89ei%2Fujla%2FqEyTuOSlcDPgr7chZ%2FqWWYM9GsiK1es%3D&reserved=0, or mute the threadhttps://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAD765PGYZ22XKM3BLSOHKG3QKKPORANCNFSM4IYED3HQ&data=02%7C01%7C%7Ce87b4bb706f040cf20e708d73c82ae18%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C637044404264975961&sdata=abADL0I948XRQ4WgR8COFzGFP8Biku791rqbr5Rtqv8%3D&reserved=0.

kalwalt commented 5 years ago

@ThorstenBux yes i agree with you, unfortunately i han not so much time to spent in this task. i hope in the weekend to have a bit of time.

kalwalt commented 5 years ago

@ThorstenBux i had no time to continue this project, sorry! My new job let me so few time to think and develop. Have you some news instead?

ThorstenBux commented 5 years ago

That is alright, no worries. :) Well, the WebWorker version did work but the video and the tracking is out of sync as the tracking is way slower than the video so I dropped that.

Then I found that the OpenCV v4 version is much slower than the OpenCV v3 version so I started to question the move to OpenCV v4. That then brought me back to my original branch where I started to move to v4 but that still has the JPEG build issues so I need to get those fixed again. That is my latest update. Need to do a profiling run still.

But looking at the NFT you published. The detection phase is way faster than everything I have. The tracking is slower though.

kalwalt commented 5 years ago

thanks for the updates Thorsten, strange that the OpenCv v4 is slower than the v3.... I hope to help you in some way

But looking at the NFT you published. The detection phase is way faster than everything I have. The tracking is slower though.

Do you think that tracking could be improved?

ThorstenBux commented 5 years ago

Probably, but so far I've only focused on the 2D tracking from artoolkitX and haven't looked into artoolkit5 NFT so I would need to check