aws-samples / amazon-sumerian-arkit-starter-app

A sample XCode project that demonstrates how to create a simple augmented reality experience using Apple's ARKit with the Amazon Sumerian service
Apache License 2.0
49 stars 27 forks source link

Host Voice in iOS AR App #9

Open CreateUp-Academy opened 5 years ago

CreateUp-Academy commented 5 years ago

I made the scene that the host speaks with polly by sumerian. I can watch the scene that the host speaks with gesture by MacBook pro.

And I made AR App by Xcode and ARkit in accordance with tutorial, I can watch the host and gesture by iPhone XR, but I cannot hear the voice. Of course the volume is not muted.

Please let me know how to solve the problem.

mike-starr commented 5 years ago

We'll look into this. Automatic playback of audio is specifically allowed in the WKWebView via webViewConfiguration.mediaTypesRequiringUserActionForPlayback = [] , but it looks like this may no longer be working.

CreateUp-Academy commented 5 years ago

Can I improve the problem?

alexander-santiago commented 5 years ago

Hi is there a solution yet for the problem? I am facing the same issue. I even tried exchanged the URL with a youtube link. I did not have any issue on that. However I had to unmute on the youtube link after it was loaded. Is there anything similiar to pass it on unmuted?

mike-starr commented 5 years ago

We've identified the problem and are working on a fix. I'll update this issue when it's released.

mike-starr commented 5 years ago

Fix is out. Please re-publish your scene in Sumerian to pick it up.

CreateUp-Academy commented 5 years ago

I cannot hear the host voice with the iOS App using this code yet.

alexander-santiago commented 5 years ago

Hi Mike, same here. I republished but unfortunately I cannot hear anything either. Within the state machine of the the Avatar before I start the speech I added the action "unmute" just to make sure that the scene is not muted.

mike-starr commented 5 years ago

I've noticed that WKWebView will sometimes cache scenes and will continue to use the cached version even if the scene's been republished. Try adding this code to ViewController.swift in the viewDidLoad function right after the call to super.viewDidLoad, which will explicitly clear its cache.

let websiteDataTypes = NSSet(array: [WKWebsiteDataTypeDiskCache, WKWebsiteDataTypeMemoryCache])
let date = NSDate(timeIntervalSince1970: 0)
WKWebsiteDataStore.default().removeData(ofTypes: websiteDataTypes as! Set<String>, modifiedSince: date as Date, completionHandler:{ })

If that doesn't work, please reach out to me (AWS-mstarr) on our public slack (https://slack.sumerian.aws) and I'll see if I can figure out what's going on with your specific scenes.

alexander-santiago commented 5 years ago

Unfortunately did not work, still silence. I will contact you on slack as suggested.

mi3ctf commented 5 years ago

Is this an old just still open or an active known issue?