search

aardvarkxr / hackathon-sep20

BSD 3-Clause "New" or "Revised" License
1 stars 0 forks source link

Cross-app fitness tracker #10

Open Si-B0RG opened 4 years ago

Si-B0RG commented 4 years ago

Wanna see how many calories you've burned since booting up Beat Saber? How about the number of squats and spins in Pistol Whip? Aardvark offers a great way to track and visualize raw motion data so users can see the health impact no matter what app they're running.

What would this gadget do? Track motion controller and HMD data and visualize it to the user over time. Could potentially track app use as well to offer insights to compare health between experiences.

Who would use this gadget? People interested in health and fitness in VR. Fans of experiences like Supernatural and Beat Saber that want a unified dashboard to track their health across myriad apps.

Assuming that you're on the team, what other skillsets would you need to make this project happen over a couple days of hacking? My strength is UX design, but I have a solid background 3D modeling. My coding skills are pretty much limited to Blueprint visual-scripting, so I could use a lot of help with development. I also know very little about actual health calculations (such as translating a punch into calories burned) so that would be good to have as well.

What will be the toughest part of building this gadget? Translating raw input data into useful health insights will be the biggest challenge.

JoeLudwig commented 4 years ago

Tracking meters moved by each controller and the head is pretty straightforward. Turning those into more abstract notions like "squat" and "spin" is tougher, but maybe not necessary?

Perhaps some helpful volunteers could wear both VR headsets and a more traditional fitness tracker to get a rough calibrations?

BOLL7708 commented 4 years ago

It has been done before, so I guess it's possible 😋 Might even be worth asking YUR if they want to join the hackathon but not sure if that meshes with their product plan 😅

Adil3tr commented 4 years ago

So YUR apparently has a smart watch overlay with dedicated game profiles. If they saw this as a big step up over their existing approach they might be interested, but the fact that they have an established business plan could mean they wouldn't be very open or collaborative about it.

For squats and spins, if you turn it on when you enter Pistol Whip or it can tell what game is running, I think that it could derive it from your height. Maybe you calibrate by doing a squat and then it makes that plane of space and counts the number of times your head dips to that point. Rotation is something a lot of overlays track, it's just a matter of only including the rotation data you want, right? Calories would require a data set and players inputting height, weight, etc in all likelihood.

Si-B0RG commented 4 years ago

Ah yes YUR! But isn't that primarily using heart rate from an external device? I suppose that's probably the best way to do it, but it's also another hardware barrier.

As for their smartwatch overlay, I was under the mistaken impression that 3d features like that were what Aardvark was enabling? If that's not the case, my preference would be to make something that highlights the unique features of the platform. Any ideas how to morph the concept into something only Aardvark can do?