aws-samples / amazon-polly-metahumans

This Unreal Engine sample project demonstrates how to bring Epic Games' MetaHuman digital characters to life using the Amazon Polly text-to-speech service from AWS. Use this project as a starting point for creating your own Unreal Engine applications that leverage Amazon Polly to give voice to your MetaHumans.
MIT No Attribution
174 stars 68 forks source link

[feature-request] allow other characters - tie it to chatgpt or gpt3 ( willing to help, others?) #25

Open stevedipaola opened 1 year ago

stevedipaola commented 1 year ago

Got it all working - thank you.

Any tips on on how to swap in other metahuman characters?

Also would be nice to tie to a realtime AI chat like gpt3 or chatgpt - anyone interested in helping with this.

Krxtopher commented 1 year ago

Glad you got things working! There's a section of the Developer Guide titled "Adding New MetaHumans" which should help you replace the swap in new characters.

I know of someone working on a project that combines the Amazon Lex chatbot service with this sample project. It would be great to see someone create a version that uses gpt3 or chatgpt!

stevedipaola commented 1 year ago

I have tried the "Adding New MetaHumans" process 3 times - but I always end up when I go back in unity after moving the new character to the common area (end of step 1) and click on the prtoject to bring unity back up where the project expects ADA and complains that her files are missing - how do you point to the new character?

Krxtopher commented 1 year ago

@stevedipaola Are you able to post a screen recording showing your process so I can see if I can spot any errors? I'll try to carve out some time soon to record a video tutorial showing how to add new MetaHumans.

stevedipaola commented 1 year ago

I did do a screen recording (with sound) of my process. Please let me know what I am doing wrong. Appreciate the timely help.

https://user-images.githubusercontent.com/4528612/211412585-1affc1ab-4dce-470e-9f35-481d5e4156fe.mp4

stevedipaola commented 1 year ago

checking in - made a video to help understand what is not working

CemCanbolat commented 1 year ago

Got it all working - thank you.

Any tips on on how to swap in other metahuman characters?

Also would be nice to tie to a realtime AI chat like gpt3 or chatgpt - anyone interested in helping with this.

Steve hi could you please reach me via email. I would be thankful for any help immensely cemcanbolat159@gmail.com

nickhollowayvid commented 1 year ago

hi @stevedipaola & @CemCanbolat - did either of you ever manage to "Add a new Metahuman" into AmazonPollyMetahuman project? - as outlined @ "Adding New MetaHumans" ? Have followed the instructions - all seems to go as described here -> "Adding New MetaHumans" - but then the original Metahuman "Ada" remains in the project as is and not replaced by the newly imported Metahuman (e.g. "Yuri" UE4 Metahuman imported via Quixel Bridge and then copied/replaced the Metahumans folder as per the instructions etc... but not showing for me in my AmazonPollyHuman UE project)- have you had any success? any tips/advice very much appreciated, thanks, thanks, nick

nickhollowayvid commented 1 year ago

...further to previous comment, here's video of screen recording of my process attempting to "Add a new MetaHuman" to AmazonPollyMetaHuman project... at the end of the process the same/original MetaHuman ("Ada") is still there and has not been replaced with new/imported MetaHuman ("Cooper") as intended - where am I'm going wrong? any advice please? much appreciated, thanks, thanks, nick

here's video of screen recording ->

https://user-images.githubusercontent.com/89219250/233063258-167d4b9d-f16b-4334-8281-6e015c2b7c55.mp4

stevedipaola commented 1 year ago

unfortunately for me ( see my posts above) - I never was able to get "Add a new MetaHuman" working - Krxtopher asked and I set up a full screen grab of everything - but I never got an answer nor has others - and the github has not been updated. It would be great if this was more than a demo but something we can all work with to make AWS talking bots. Please consider updating us and the project.