ButzYung / SystemAnimatorOnline

XR Animator, AI-based Full Body Motion Capture and Extended Reality (XR) solution, powered by System Animator Online
https://sao.animetheme.com/XR_Animator.html
788 stars 66 forks source link

[Feature Request] New VMC application mode for VRChat OSR #50

Open Gensokian opened 8 months ago

Gensokian commented 8 months ago

I fiddled around with your implementation of VMC to be sent to port 9000 (by editing the config file because the app only allows 5 digits for... Reasons ^^) VRChat seems to catch those parameter in the ocr debugger too, but on the path /VMC/ext/..... Is not what VRChat expects

I snooped around and found MMD_SA.js to be handling the connections but wasn't skilled enough to modify it accordingly (or without breaking anything else)

Is there a support for VRChat planned? This would help many people without VR to express themselves further instead of just standing there... MENACINGLY!

ButzYung commented 8 months ago

I am actually quite interested in supporting VRChat, but the problem is I am not that familar with VRChat, and AFAIK VRChat doesn't interpret OSC/VMC the way VMC protocol does, as you can't really directly transform the bone rotations of VRChat avatar via OSC like a conventional VTuber app. I will need to find some time and actually take a look of how VRChat OSC works.

Flopsi99 commented 7 months ago

Id second this, I would be extremely happy if you could make it work for vrchat, I currently use your software for vtubing and have been amazed with it, but all the alternatives that do work with vrchat are much worse than your tracking. I really hope you can make this work I do have vr but id love to have full body tracking enabled with this software

I could research which data youd really need in order to use it or link you to another program that already does it, if that would be any help