search

guansss / pixi-live2d-display

A PixiJS plugin to display Live2D models of any kind.
https://guansss.github.io/pixi-live2d-display/
MIT License
807 stars 123 forks source link

Lip sync support for cubism 2+4! #102

Open RaSan147 opened 1 year ago

RaSan147 commented 1 year ago

Is it possible to real time .wav to lip sync using pixi-live2d? Also if not please add support or kindly provide some other way round... (Couldn't access lip element atteibute from this module, if is possible maybe there's a way round)

RaSan147 commented 1 year ago

made it possible (with some fixes)

https://github.com/RaSan147/pixi-live2d-display

RaSan147 commented 1 year ago

https://user-images.githubusercontent.com/34002411/230723497-612146b1-5593-4dfa-911d-accb331c5b9b.mp4

😭 i'm crying.... finally its done

DariusTans commented 1 year ago

Hi i'm the newbie with this. I want to use this version from you. how can i do this ? @RaSan147

RaSan147 commented 1 year ago

@DariusTans Umm I'll update the docs asap.

RaSan147 commented 1 year ago

@DariusTans readme updated

https://github.com/RaSan147/pixi-live2d-display/blob/master/README.md#basic-usage

DariusTans commented 1 year ago

@RaSan147 Thank you so much 🙏🙏

kikiimdev commented 1 year ago

@DariusTans readme updated

https://github.com/RaSan147/pixi-live2d-display/blob/master/README.md#basic-usage

Thanks, is it only possible on Cubism2 model? i tried it on Cubism4 model, the sound play but not with the lipsync

kikiimdev commented 1 year ago

@DariusTans readme updated https://github.com/RaSan147/pixi-live2d-display/blob/master/README.md#basic-usage

Thanks, is it only possible on Cubism2 model? i tried it on Cubism4 model, the sound play but not with the lipsync

NVM, its work, if your model lip sync didn't work, try adding LipSync Ids in your .model3.json

Ref: Live 2D Docs

RaSan147 commented 1 year ago

@DariusTans readme updated https://github.com/RaSan147/pixi-live2d-display/blob/master/README.md#basic-usage

Thanks, is it only possible on Cubism2 model? i tried it on Cubism4 model, the sound play but not with the lipsync

it works perfectly on standard cubism 4 model image

@DariusTans readme updated https://github.com/RaSan147/pixi-live2d-display/blob/master/README.md#basic-usage

Thanks, is it only possible on Cubism2 model? i tried it on Cubism4 model, the sound play but not with the lipsync

NVM, its work, if your model lip sync didn't work, try adding LipSync Ids in your .model3.json

Ref: Live 2D Docs

there might be a chance that your model objects don't use standard partition ids (yes they have standards on it)

DariusTans commented 1 year ago
Thankyou so much  Sent from Mail for Windows From: Ratul HasanSent: Tuesday, June 27, 2023 2:09 PMTo: guansss/pixi-live2d-displayCc: DariusTans; MentionSubject: Re: [guansss/pixi-live2d-display] Lip sync support for cubism 2+4! (Issue ***@***.*** readme updatedhttps://github.com/RaSan147/pixi-live2d-display/blob/master/README.md#basic-usageThanks, is it only possible on Cubism2 model? i tried it on Cubism4 model, the sound play but not with the lipsyncit works perfectly on standard cubism 4 ***@***.*** readme updatedhttps://github.com/RaSan147/pixi-live2d-display/blob/master/README.md#basic-usageThanks, is it only possible on Cubism2 model? i tried it on Cubism4 model, the sound play but not with the lipsyncNVM, its work, if your model lip sync didn't work, try adding LipSync Ids in your .model3.jsonRef: Live 2D Docsthere might be a chance that your model objects don't use standard partition ids (yes they have standards on it)—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: ***@***.***>