search

googlesamples / assistant-sdk-python

Samples and bindings for the Google Assistant API
http://developer.google.com/assistant/sdk
Apache License 2.0
916 stars 320 forks source link

Support of Media Responses #203

Open hyzhak opened 6 years ago

hyzhak commented 6 years ago

I'm working right now on action which uses Media Responses (https://github.com/internetarchive/internet-archive-google-action) and would like to use my AIY Voice kit here. But AIY responses that it doesn't support Media Response. Is there any plan to support Media Response in this SDK? https://developers.google.com/actions/assistant/responses#media_responses Could I expect it in near future?

Fleker commented 6 years ago

Yeah the APIs in the SDK don't support media right now. Thanks for the feedback.

hyzhak commented 6 years ago

You are welcomed! Could I expect it on DIY device soon or give up all hope?

Fleker commented 6 years ago

It's something I'd like to support, although I don't have a specific date for when it'd be ready.

hyzhak commented 6 years ago

Great! Thanks :)

hyzhak commented 6 years ago

Hi there! What's news? Is there any chance to see this feature soon?

Fleker commented 6 years ago

I do not have an update today.

fdambrosio commented 6 years ago

Hi, I have the same feature request too, thanks

Fleker commented 6 years ago

The library now supports playback of news & podcasts.

hyzhak commented 6 years ago

@Fleker Cool! Does it mean that we can use Media Response for playing random audio files?

Fleker commented 6 years ago

You'll be able to say something like "Hey Google, play This American Life" and get the podcast.

For playing random audio files, it would be better to use a custom device action so that "Play random audio files" would get received and you would then handle that by playing a random audio file.

hyzhak commented 6 years ago

@Fleker sure, we are developing custom device action for Internet Archvie but recently I couldn't send Media Response, because Assistant SDK (and AIY Voice in particular) didn't support Media Responses. In other words:

conv.surface.capabilities.has('actions.capability.MEDIA_OUTPUT') === false

Can I use them after the last update?

Fleker commented 6 years ago

Honestly I have not tried AoG with the library yet. If you set up the Conversation Components sample, you may be able to run it, ask for media, and see what happens.

Fleker commented 6 years ago

Did you ever see if this works?

hyzhak commented 6 years ago

@Fleker I have asked Google AIY team to update their software to fetch new version of Assistant SDK https://github.com/google/aiyprojects-raspbian/issues/304. so let see, will it help or not.

dmarvp commented 4 years ago

hi @Fleker I'm also interested in getting media responses within the assistant sdk. Are there any news related to that?