sebastianstarke / AI4Animation

Bringing Characters to Life with Computer Brains in Unity
7.79k stars 1.05k forks source link

VR Demo head / player movement #130

Closed qlee01 closed 1 month ago

qlee01 commented 1 month ago

Nice work on the 2024 stuff. One thing I noticed though is that the algorithm enforces some artificial movements on the player location in many situations, which might lead to motion sickness. A mode where movement is only governed by the HMD would be preferable, and only do locomotion of player transform if stick is being used.

Also would like to second the question about licensing for commercial use.

paulstarke commented 1 month ago

Hi @qlee01, in the VR demo you should be able to control the character with HMD and only when using the joystick the system will apply additional movement. Which device are you using?

qlee01 commented 1 month ago

Hi @qlee01, in the VR demo you should be able to control the character with HMD and only when using the joystick the system will apply additional movement. Which device are you using?

I am using quest 3 over meta link. Per default, no camera was rendering to the HMD, so I tried all three cameras by switching them to display 1 and setting output to both eyes. On all of them I saw additional movement, also visible on the parent transforms of the cameras in the editor.

P3t3r95 commented 1 month ago

I echo what @qlee01 said, nice work! Any comments about the licensing for commercial use? 🤞

paulstarke commented 1 month ago

Hi @qlee01, in the VR demo you should be able to control the character with HMD and only when using the joystick the system will apply additional movement. Which device are you using?

I am using quest 3 over meta link. Per default, no camera was rendering to the HMD, so I tried all three cameras by switching them to display 1 and setting output to both eyes. On all of them I saw additional movement, also visible on the parent transforms of the cameras in the editor.

Hi @qlee01, I just tested on Quest 3 successfully. Please double check the following camera settings in the 3PT scene:

ScreenSpace Camera

HeadSpace Camera

TrackingSpace Camera

Note that you need an open gaming view in the inspector which renders to Display 3. Screenshot 2024-07-20 224011 Hope this helps!

paulstarke commented 1 month ago

There is now a VR-demo .apk for this project that you can install on your headset without the need of link-cable.