search

HARPLab / DReyeVR

VR driving 🚙 + eye tracking 👀 simulator based on CARLA for driving interaction research
https://arxiv.org/abs/2201.01931
MIT License
139 stars 37 forks source link

eye tracking #142

Closed FBanani closed 5 months ago

FBanani commented 8 months ago

Hi @ajdroid

I understand my eye tracking has problems. First issue is about installation of "VIVE_SRanipalInstaller_1.3.2.0.msi". I found the solution. but the problem is that the color of robot eyes doesn't change, and it is gray! what should I do? the second one I found out during my installation I used the wrong SDK version "1.3.6.6" I downloaded the correct version and put it on the Carla toot/unreal/plugins. what should I do for the next step. Should I uninstall the DreyeVr and reinstall again? could you help me? I really need help. I made 6 different maps for my experiment I don't want to uninstall Carla. what should I do?

ajdroid commented 8 months ago

What exact VR headset model are you using?

On Wed, Oct 11, 2023, 5:59 PM Fatemeh @.***> wrote:

Hi @ajdroid https://github.com/ajdroid

I understand my eye tracking has problems. First issue is about installation of "VIVE_SRanipalInstaller_1.3.2.0.msi https://hub.vive.com/en-US/download/VIVE_SRanipalInstaller_1.3.2.0.msi". I found the solution. but the problem is that the color of robot eyes doesn't change, and it is gray! what should I do? the second one I found out during my installation I used the wrong SDK version "1.3.6.6" I downloaded the correct version and put it on the Carla toot/unreal/plugins. what should I do for the next step. Should I uninstall the DreyeVr and reinstall again? could you help me? I really need help. I made 6 different maps for my experiment I don't want to uninstall Carla. what should I do?

— Reply to this email directly, view it on GitHub https://github.com/HARPLab/DReyeVR/issues/142, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACOIHWJFU7SJY2G4Q5U2MHLX64JFJANCNFSM6AAAAAA54VBBAM . You are receiving this because you were mentioned.Message ID: @.***>

FBanani commented 8 months ago

What exact VR headset model are you using? … On Wed, Oct 11, 2023, 5:59 PM Fatemeh @.> wrote: Hi @ajdroid https://github.com/ajdroid I understand my eye tracking has problems. First issue is about installation of "VIVE_SRanipalInstaller_1.3.2.0.msi https://hub.vive.com/en-US/download/VIVE_SRanipalInstaller_1.3.2.0.msi". I found the solution. but the problem is that the color of robot eyes doesn't change, and it is gray! what should I do? the second one I found out during my installation I used the wrong SDK version "1.3.6.6" I downloaded the correct version and put it on the Carla toot/unreal/plugins. what should I do for the next step. Should I uninstall the DreyeVr and reinstall again? could you help me? I really need help. I made 6 different maps for my experiment I don't want to uninstall Carla. what should I do? — Reply to this email directly, view it on GitHub <#142>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACOIHWJFU7SJY2G4Q5U2MHLX64JFJANCNFSM6AAAAAA54VBBAM . You are receiving this because you were mentioned.Message ID: @.>

thanks for replying. HTC VIV PRO 2

ajdroid commented 8 months ago

We have not tested that headset but you should be able to get it to work with some hacking. Can you use it with steam VR and calibrate the eye tracking via the steam interface?

On Wed, Oct 11, 2023, 6:40 PM Fatemeh @.***> wrote:

What exact VR headset model are you using? … <#m-6272288233936334513> On Wed, Oct 11, 2023, 5:59 PM Fatemeh @.> wrote: Hi @ajdroid https://github.com/ajdroid https://github.com/ajdroid https://github.com/ajdroid I understand my eye tracking has problems. First issue is about installation of "VIVE_SRanipalInstaller_1.3.2.0.msi https://hub.vive.com/en-US/download/VIVE_SRanipalInstaller_1.3.2.0.msi https://hub.vive.com/en-US/download/VIVE_SRanipalInstaller_1.3.2.0.msi". I found the solution. but the problem is that the color of robot eyes doesn't change, and it is gray! what should I do? the second one I found out during my installation I used the wrong SDK version "1.3.6.6" I downloaded the correct version and put it on the Carla toot/unreal/plugins. what should I do for the next step. Should I uninstall the DreyeVr and reinstall again? could you help me? I really need help. I made 6 different maps for my experiment I don't want to uninstall Carla. what should I do? — Reply to this email directly, view it on GitHub <#142 https://github.com/HARPLab/DReyeVR/issues/142>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACOIHWJFU7SJY2G4Q5U2MHLX64JFJANCNFSM6AAAAAA54VBBAM https://github.com/notifications/unsubscribe-auth/ACOIHWJFU7SJY2G4Q5U2MHLX64JFJANCNFSM6AAAAAA54VBBAM . You are receiving this because you were mentioned.Message ID: @.>

thanks for replying. HTC VIV PRO 2

— Reply to this email directly, view it on GitHub https://github.com/HARPLab/DReyeVR/issues/142#issuecomment-1758644547, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACOIHWI5BO5TVBWUZ7NGY7LX64N65ANCNFSM6AAAAAA54VBBAM . You are receiving this because you were mentioned.Message ID: @.***>

FBanani commented 8 months ago

this is the exact headset that shows n your github image image

ajdroid commented 8 months ago

As mentioned in our README, we use the HTC Vive Pro Eye image

ajdroid commented 8 months ago

I'm not even sure that the Pro2 has eye tracking built-in

FBanani commented 8 months ago

it has eye tracking but while I try to do it showed me initialization failed.

FBanani commented 8 months ago

I'm not even sure that the Pro2 has eye tracking built-in

image

ajdroid commented 8 months ago

If you can find the SDK for enabling Vive Pro 2 eye tracking, you can use that and integrate it with DReyeVR. It doesn't look like the VIVE Pro 2 is supported by SRanipal (so we can't support it out of the box)

FBanani commented 8 months ago

Thanks

FBanani commented 8 months ago

I try to fix this issue, because I ordered the HTC VIVE PRO eye tracking and I found out they sent me wrong product. I have another question, which is about the SDK version. Should I reinstall the DReyeVR again or it works just with putting the correct version in carla root/unreal/... directory?

ajdroid commented 8 months ago

Do you mean for the Vive Pro Eye? If you use the supported Vive Pro Eye, you don't need to change anything -- just installing the SRanipal as described in the Install instructions will work. However, if you are trying to use a new SDK for the VIVE Pro 2, that is a much more involved effort and you'll need to change the DReyeVR source code to support it.

FBanani commented 8 months ago

Yes, for Vive Pro Eye. what I understand is just putting the plugin in the root of carla. "unzip the SRanipal unreal plugin and copy over the 03_Unreal/Plugins/SRanipal/ directory to the Carla installation" after that what should I do?

ajdroid commented 8 months ago

You also need to install the .msi file but I think you already did that. You don't need to do anything else

FBanani commented 8 months ago

Thanks. to confirm, if I just had new headset, and put the file in a correct directory. I could do my experiment without doing anything els. am I correct?