Make it work with Star Citizen ?

[hervedumoulinarc]

I love Star Citizen and Im in my way of looking for a good headtracking tool with HoloLens... Seem I found one. I already installed HololensArucoUnity on my HoloLens, when I lauch It I have two Windows and text written " Markers : 0" From here I followed the steps but I must admit It's difficult for me because I don't really understand what is It for... and if It Will really meet my needs for Star Citizen. Coule you Give me some kind of help of any genre

[qian256]

Hi,

If your purpose is to track user's head (in world coordinates), the suggestion is:

1. Modify the aruco wrapper to open access to the detailed tracking information of each marker: for each marker, there is a Rodriguez vector representing rotation, and a translation vector (opencv Rvec, Tvec).
2. Reconstruct the pose of camera with respect to marker by combining Rvec and Tvec.
3. Step 2 can be done at every frame, but it is slow. Update it every few frames or in parallel.

The purpose of current implementation of HoloLensArucoUnity is to demonstrate the integration of aruco and opencv for uwp platform. The visualization is not awesome yet. That's why currently it is only showing the number of markers and ids of them.

[hervedumoulinarc]

Thanks. Eventually do you have a room or Group on Slack, Telegram or Github where we could have a chat someday. Im not sure I could do this alone.

Envoyé de mon téléphone Windows 10

De : Long Qianmailto:notifications@github.com Envoyé le :mercredi 30 novembre 2016 15:29 À : qian256/HoloLensArucoUnitymailto:HoloLensArucoUnity@noreply.github.com Cc : hervedumoulinarcmailto:herve.dumoulin@outlook.com; Authormailto:author@noreply.github.com Objet :Re: [qian256/HoloLensArucoUnity] Make it work with Star Citizen ? (#1)

Hi,

If your purpose is to track user's head (in world coordinates), the suggestion is:

1. Modify the aruco wrapper to open access to the detailed tracking information of each marker: for each marker, there is a Rodriguez vector representing rotation, and a translation vector (opencv Rvec, Tvec).
2. Reconstruct the pose of camera with respect to marker by combining Rvec and Tvec.
3. Step 2 can be done at every frame, but it is slow. Update it every few frames or in parallel.

The purpose of current implementation of HoloLensArucoUnity is to demonstrate the integration of aruco and opencv for uwp platform. The visualization is not awesome yet. That's why currently it is only showing the number of markers and ids of them.

- You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/qian256/HoloLensArucoUnity/issues/1#issuecomment-263886702, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AND6mC4ep8EjrPcaUTCrMzvfVk93co9sks5rDYglgaJpZM4LAIXb.

[qian256]

Not yet, but I am absolutely willing to help

[hervedumoulinarc]

Hi How are you ? Thanks for your help. I have errors when I try buiding CMake for UWP with CMake 3,7...

In the readme it say "...set an environment variable..." but maybe it's for openCV...

[qian256]

Have you installed the build tools of VS2015? I found this post that might be helpful for you: http://stackoverflow.com/questions/31619296/cmake-does-not-find-visual-c-compiler

[hervedumoulinarc]

Thanks you, Qian, That was good help. If you willing to help me a bit more, now I have difficulty to finish building CMake for UWP.

[hervedumoulinarc]

Hi, Im still working on my project. Concerning the precedent error, I managed to passthrough, I don't need to rebuild CMake as all the support for UWPs has been part of CMake releases for a while now. The next step is to build Opencv Binaries... What does it means : It is part of opencv "set an environment variable" readme. Im going very slowly, but I hope it will work at the final, What do you think ? I have Sunday night as deadline for this demo, I want to show it for my birthday... :)

[qian256]

Thanks for updating. It's good to know that the current release supports UWP already. It seems that it is trying to build test and perf binaries of opencv, which are not necessary for HoloLens applications. Wish you good luck and happy birthday!

[hervedumoulinarc]

Thanks ! I have another little question. You wrote How could I do this ?

[hervedumoulinarc]

Also should I build opencv with CMake or VSstudio 2015 ?

[qian256]

You can google search Aruco marker generator to generate a marker then simply print it. For opencv, you should generate the vs2015 solution of it using cmake, then build the actual binary using vs2015.

[hervedumoulinarc]

Thanks a lot, how many markers do I need for my project of headtracking ? 4 for each angle of the screen ? On hololens there are two screens appearind in Hologram, it's disturbing, is it normal ? When you say "Modify the aruco wrapper to open access to the detailed tracking information of each marker" Do I need coding skill ! Again Thanks a lot Qian ..

[qian256]

Only one marker is fine. Currently, the two screens are the effect. The original capture is displayed on the lest, the processed image is displayed on the right. The processed image shows the tracking result. If you want to use the tracking result for advanced visualization, like some virtual object in the scene, you have to code a little bit!

[hervedumoulinarc]

Ok understand, I can see Something displaying in yellow on the marker in the right picture, but it's very small... I cannot describe What Im seeing What is the meaning of this information ? do I need it ? Thanks !

[hervedumoulinarc]

Uhh :( I get this when trying generating aruco with cmake, seems not very compelling but Im stuck for the moment...

[loowee2k5]

Hey HerveyDuMoulinarc ! I am a long term SC pledger and Ive been looking for a month to find a reliable streamer for star citizen to my Hololens. The remote desktop app just isnt fast enough, adding to the game's lag, it's a nightmare. Did you manage to get any decent stream going ? The head tracking would certainly make it even better !! Thx