Open ilNikk opened 1 year ago
This blog https://zhuanlan.zhihu.com/p/609878670 explains the initial design of muvtuber. It may help you to understand things.
what is the signal flow for the lipsync and the others motion?
The command {"motion":"xxx"}
toggles on a live2d motion. And there is no lip-sync (for now).
The character does not currently play any action.
fwd msg: {} -> http://localhost:51070 should not be empty right? should be {motion:flick_head}?
The motion controlling depend on the emotion analysis module (emotext). If there are no emotion detected, it sends this empty command. This empty message do not change anything so the live2d model keeps idle. It's harmless.
Maybe this function is only vincolated by musharing_chatbot response insted of the azure response (i use chatgpt for response)?
It works for any output text (musharing_chatbot or chatgpt).
Some time i get flick_head but its not perfect synced and have delay.
The depended live2d library is not supporting lip-sync for now. So I made a workaround for lip-sync that is:
Repeating a live2d motion which contains lip motion to emulate the lip-sync.
So it delays and not looks well.
Hi! what is the signal flow for the lipsync and the others motion? i try to translate the redme.md but i cant see nothing about. The character does not currently play any action. Maybe this function is only vincolated by musharing_chatbot response insted of the azure response (i use chatgpt for response)?
live2ddriver
fwd msg: {} -> http://localhost:51070
should not be empty right? should be{motion:flick_head}
? Who decides this string?Some time i get flick_head but its not perfect synced and have delay.
another little problem is that if I enable ReadDm (from muvtuberdriver config file) it would seem that a motion request is not made, but only the chatgpt response