virtual-puppet-project / vpuppr

VTuber application made with Godot 4
Mozilla Public License 2.0
735 stars 61 forks source link

Linux KDE no face tracking data #40

Closed vladimir-sama closed 2 years ago

vladimir-sama commented 2 years ago

My working camera does not start face tracker, I followed QuickStart instructions and tried running it with the terminal.

Godot Engine v3.4.beta.custom_build.5fdd3ff95 - https://godotengine.org
OpenGL ES 3.0 Renderer: AMD Radeon(TM) Vega 8 Graphics (RAVEN, DRM 3.41.0, 5.13.8-artix1-1, LLVM 12.0.1)
OpenGL ES Batching: ON
...
Loading VRM file.
...
Model has ultra nested meshes: .
Model has ultra nested meshes: .
Starting face tracker.
Listening for data at 127.0.0.1:11573
Face tracker started.
No face tracking data found. <--- Here
...
Stopping face tracker.
Face tracker stopped.
Saving config
Finished saving config
Exiting.

No face tracking data found, latest version

ItsRogueRen commented 2 years ago

You need to run OpenSeeFace separately in a terminal (I use this on Pop!_OS 21.04 with KDE)

https://github.com/emilianavt/openseeface

you-win commented 2 years ago

How long did you leave the program running for? When first starting the tracker, it can take a few seconds for data to actually start sending.

The No face tracking data found. message is because the program tries to automatically set your facial offsets when the tracker is still starting/warming up.

If the tracker wasn't able to start, you should've seen a Failed to start tracker message. Even though the full log isn't here, I can see that the Face tracker started. message is present, which indicates that a PID for the face tracker was obtained.

vladimir-sama commented 2 years ago

How long did you leave the program running for? When first starting the tracker, it can take a few seconds for data to actually start sending.

About 15 seconds, this fixed it:

You need to run OpenSeeFace separately in a terminal (I use this on Pop!_OS 21.04 with KDE)

I searched in the folders and there doesn't seem to be a Linux executable to run OSF, just DLL's Using release version 0.7.0 for Linux

EDIT: My camera has a light, which doesn't start when I turn on tracking

ItsRogueRen commented 2 years ago

How long did you leave the program running for? When first starting the tracker, it can take a few seconds for data to actually start sending.

About 15 seconds, this fixed it:

You need to run OpenSeeFace separately in a terminal (I use this on Pop!_OS 21.04 with KDE)

I searched in the folders and there doesn't seem to be a Linux executable to run OSF, just DLL's Using release version 0.7.0 for Linux

EDIT: My camera has a light, which doesn't start when I turn on tracking

OSF-GD can't run OSF on Linux as an executable without You-win making and compiling OSF into a Linux executable. What should be coming is a button that run the terminal commands to run OSF for people that have it installed.

If you need more help with getting OSF set up, I have several videos on my YouTube channel

you-win commented 2 years ago

Oof. The current release should try to run OpenSeeFace via python. Looks like it's running the interpreter without actually running OpenSeeFace. I'll have to fix that.

Not sure what's going on with the camera light. Regardless of the program, your camera light should turn on when it's recording

vladimir-sama commented 2 years ago

your camera light should turn on when it's recording

It does actually, just not with OSF GD only. Should this be closed now?

you-win commented 2 years ago

Ah that makes sense.

This issue should be kept open since the tracker should be startable from within the application on Linux (or at least show an error in the logs).