For those you want to know ;).
You can make basketball game but:
The tracking is precise to 10-80 cm
You can't do a multiplayer (except if we can detect other headset with infrared to avoid collision. On my list of questions)
It is really hard to dribble without the camera. But with it is kind of ok.
It is impossible to shot correctly because of no depth in long range in cameras.
You really can run freely if you are alone on the court.
If we can use the camera and extract the sphere of the ball. We could maybe have a basket ball tracked. And so to be able to play basketball. (Hard but not impossible)
Make game on a basketball field is cool. But it does not have enough tracking for quality experiments. You need to add big object on the field to improve it. (Not good for basketball).
Turning around is working well. But turn very quickly the head is a guaranty to lost the tracking.
-...
https://youtu.be/1gzYlLiG0jg