ButzYung / SystemAnimatorOnline

XR Animator, AI-based Full Body Motion Capture and Extended Reality (XR) solution, powered by System Animator Online
https://sao.animetheme.com/XR_Animator.html
765 stars 64 forks source link

VRM model loading issue #16

Open ItsRogueRen opened 1 year ago

ItsRogueRen commented 1 year ago

Loaded my VRM model into the Linux build of this, and found some textures didn't load correctly, the most noticeable being that blacks were loaded as gray, and some textures looked like they didn't not have any aliasing.

Unsure is this is a model issue or how XR Animator loads VRM models, but I haven't had this happen in other Vtuber software.

image

ButzYung commented 1 year ago

I use the official three.vrm plugin from pixiv to render VRM model, and AFAIK starting from v1.0 the plugin only handles MToon materials, which may be an issue if some materials have custom shaders. Another possible cause may be lighting. By default, the directional light is straight from the above (you can change it in UI/Options=>Visual Effects). This may explain the color change of your textures. However, if you suspect the cause may be errors, you can click the tray menu icon of XR Animator (somewhere around the top right of Ubuntu), choose DevTools, click the Console tab and see if there is any error message in red.

As for anti-aliasing, I use the default MSAA alone for simplicity and performance. MSAA is a good AA for geometries, but not textures. Other apps probably use MSAA+FXAA, SSAA, or something else.

ItsRogueRen commented 1 month ago

Coming back to this after a few updates, lighting was indeed the issue. However there is still an issue with loading where the model is not centered correctly and every time I reset my position I'm staring at my legs rather than my head or torso