ruyo / VRM4U

Runtime VRM loader for UnrealEngine5
Other
1.41k stars 184 forks source link

VMC Protocol in Standalone mode is not receiving motion data #422

Open stillsameshark opened 2 months ago

stillsameshark commented 2 months ago

Describe the bug I tried streaming motion data from Vseeface into UE via VMC, and it worked fine in the editor, including the "simulate" and "PIE" modes. However, the motion data was not streamed in"Standalone" mode.

[UE5.4.4]

I encounter similar issues with Livelink Face and another body motion capture solution plugin.

For the Livelink face, I realized the motion data was streaming into the editor and blocked by it. I have to delete the preset in the editor and assign the Livelink preset in the project set to make UE receive Livelink data only until I launch standalone.

Another Mocap plugin has a function called "Connect Mocap Server," which runs the motion data source server IP connection in Event Begin Play when the standalone launches.

Does VRM4U VMC have a similar function or setting about this?

As always, thank you for your kind help.

syui commented 2 months ago

I am having a similar problem.

webcam motion capture(vmc) -> vseeface(vmc) -> vrm4u(vmc)

example

vseeface port:39539, >39501 issue-9-0002

webcam port:39501 issue-9-0003

ue5.4.4 vmc:39539 issue-9-0004

Note: Launch the build exe and check after shutting down Unreal Engine. When unrealengine is running, vmc will not work with standalone or build(exe).

stillsameshark commented 2 months ago

Hi syui, thanks for sharing your experience. webcam(vmc) -> vseeface(vmc) is a interesting workaround, I will try on it.

I also have another frequent issue, VMC always suddenly stops working on a vrm. But whenever I reimport the vrm, and set up the exact same Animation blueprint, the VMC streaming will work again.

Have you ever encountered similar issues?

syui commented 2 months ago

When used simultaneously with the rvc client, it would periodically stop working.

syui commented 2 months ago

@haukakei issue of vmc face expressions not working in standalone mode, remove LiveLink presets to avoid this?

ref

stillsameshark commented 2 months ago

@syui Thanks for help!

I followed this ref vide which did solve my issue for Livelink face, I read similar article from Rokoko as well, seems like all mocap solution working via UE Linklink plugin can be solved with this LiveLink presets workaround. I will read the Vicon article to see whether there's something new.

I am not using rvc, this is weird.

syui commented 2 months ago

Thanks for help

syui commented 2 months ago

@haukakei Does this work?

  1. run package build(exe)
  2. shutdown unreal engine (editor)
  3. run exe

It seems that it is not possible for both apps to receive the vmc.

ruyo commented 1 month ago

Thanks for the report. It will be fixed in the next release.

When starting Standalone, Port was already being used by the editor, so it was not possible to bind Port on the new process side. In the next release, Port Bind in the editor will be released when the standalone process starts.

stillsameshark commented 1 month ago

syui

Hi Syui, Thank you for your solution. I am working on a Live project, which made it difficult for me to build a package, but it is nice to know where the problem is; I will try it!

stillsameshark commented 1 month ago

Thanks for the report. It will be fixed in the next release.

When starting Standalone, Port was already being used by the editor, so it was not possible to bind Port on the new process side. In the next release, Port Bind in the editor will be released when the standalone process starts.

Hi Ruyo, Thank you so much for the new update!!!