Fully implement procedural body animation in desktop & VR (without fullbody)

Frooxius commented 1 month ago

Is your feature request related to a problem? Please describe.

Currently the avatar animations in desktop and VR without fullbody are very limited and don't look too well or realistic, making desktop avatar in particular very stiff. The pieces of the system that are implemented are very barebones.

Describe the solution you'd like

Implement system that is able to simulate following in as much realistic manner as possible:

Leg movement
Arm movement
Head movement
Finger movement

This system will be responding to user's motion in the world and be able to react to:

Walking - forward, sideways, backwards etc with realtime adaptation
Running - switching to a different gait
Jumping (e.g. arms will move realistically and respond to jumping / falling)
Idle animations (e.g. looking at people who are talking)

This will also likely integrate with other systems:

EyeManager (to sync with head movements)
Proxy/setting components specifying default arm poses and such to adapt to differently sized avatars
Other components to help configure how specific avatar responds

Describe alternatives you've considered

Using an animation system, but this has a number of issues:

Resonite is currently lacking extensive animation system, which would make a big requirement for this
Procedural animations can be significantly more adaptive, producing more realistic results than baked animations

Additional Context

This will likely replace/supersede the gait system in VRIKAvatar with a more generic system, that will work across avatars - including non-IK ones.

My goal is to make this as generic and modular as possible as well - e.g. finger posing systems that could split out into their own systems and so on or even generic components for simulating realistic leg movements/gaits, so they can be used to compose other avatars and behaviors.

It'll also lend itself to implementing this: https://github.com/Yellow-Dog-Man/Resonite-Issues/issues/2030

Requesters

A business client - this item is currently high priority for this reason and is prioritized as a result.

Veeridian commented 1 month ago

Just some reference material I had found on the natural walking gait. It includes hip, knee, ankle and foot angles during the phases of walking. https://youtu.be/QAnEhz6Eqn4

troyBORG commented 3 weeks ago

This also looks like a good video for a running animation.
https://youtu.be/Jd8Jijb7jZY

Frooxius commented 3 weeks ago

I've seen that video. I appreciate trying to help, but I'm not currently looking for any more references, I've already been working with multiple.

Yellow-Dog-Man / Resonite-Issues