search

joaen / maya-auto-lip-sync

A tool to automatically generate lip sync animations in Autodesk: Maya using Montreal Forced Aligner.
MIT License
27 stars 6 forks source link

Generating Keyframes in MAYA 2020 #1

Closed TheRealMadrid closed 1 year ago

TheRealMadrid commented 1 year ago

Hi,

I seem to be having issues using this .wav file (resampled to 16kHz mono) and accompanying text file in generating keyframes for my animation.

wav and txt files: https://drive.google.com/drive/folders/1ghHfuH8O9Xg-8JUCLX91fQIZulmw9doo?usp=sharing

image

Any solution would be greatly appreciated, thanks :)

joaen commented 1 year ago

Hi! Could you please try naming the .txt-file so it has the same name as .wav-file?

I'm sorry for the lack of error handling. That's something I want to address in the future.

TheRealMadrid commented 1 year ago

Hi, thanks for the reply.

I've tried renaming both files to speech.wav and speech.txt and still seem to have the same issue.

image

joaen commented 1 year ago

Ah, ok. I think I found the issue. I will submit a fix later tonight!

joaen commented 1 year ago

I updated the script. Please try syncing the latest from github and make sure that the montreal-forced-aligner is in the correct folder. Let me know how it goes!

TheRealMadrid commented 1 year ago

Hi,

Thanks for the update. I believe there is a problem with running mfa_align.exe.

image

joaen commented 1 year ago

It seems like your montreal-force-aligner folder path is incorrect.

Does this path exist? C:/Users/[user]/Documents/maya/2020/scripts/montreal-forced-aligner/bin/mfa_align.exe

TheRealMadrid commented 1 year ago

It seems like when the project file is not located in the C: drive, it fails to run the mfa_align subprocess (despite your auto-lip-sync.py correctly identifying the appropriate paths). When moving the project file into the C: drive, it now recognises mfa_align.

image

Overall, I am happy to confirm that your script is now working correctly on MAYA 2020! Thanks for all the support! :)