Hand position is not sent to the shared state

jbarnoud commented 6 months ago

The VR client correctly sends the position of the controllers. However, it does not send the position of the hands, sending the last position of the controllers instead.

Note that the protocol does not know about hand tracking. Sending the hand position can be done in two ways:

either the hands can be sent as if they were controllers. We lose the finger details, but the data is familiar to the existing ecosystem.
or we send the hands in a new value format. We store the most data but Nanover iMD will need some tweaking to display the hands.

I have no preference.

rhoslynroebuck commented 6 months ago

@jbarnoud Could we do a combination of the both for the moment?

jbarnoud commented 6 months ago

In theory it would work, indeed.

rhoslynroebuck commented 6 months ago

Great, I will work on that.

Ragzouken commented 5 months ago

This pull request sends the root hand position in place of the controller position, which is a start: https://github.com/IRL2/SubtleGame/pull/192

IRL2 / SubtleGame

Hand position is not sent to the shared state #150