aws-samples / amazon-polly-metahumans

This Unreal Engine sample project demonstrates how to bring Epic Games' MetaHuman digital characters to life using the Amazon Polly text-to-speech service from AWS. Use this project as a starting point for creating your own Unreal Engine applications that leverage Amazon Polly to give voice to your MetaHumans.
MIT No Attribution
178 stars 67 forks source link

How to extend this project to different languages? #5

Closed luopeixiang closed 2 years ago

luopeixiang commented 2 years ago

This is an amazing demo. I would like to ask how should I modify the code to make the demo support different languages like Chinese?

cwalkere commented 2 years ago

I'm not sure how well the the animation visemes would match up when using Mandarin since the visemes were created with English in mind, but you can experiment by adding the language you'd like to these files:

https://github.com/aws-samples/amazon-polly-metahumans/blob/main/Source/AmazonPollyMetaHuman/Public/VoiceId.h https://github.com/aws-samples/amazon-polly-metahumans/blob/main/Source/AmazonPollyMetaHuman/Private/VoiceId.cpp

then recompile, then go into the unreal editor and go to the Ada blueprint (https://github.com/aws-samples/amazon-polly-metahumans/blob/main/Content/AmazonPollyMetaHuman/Ada/BP_Ada.uasset) and find where the voice id is being set and changing that from the current voice ID to the new one you added in the dropdown. Recompile again and it should then speak in that different language.