microsoft / TemplateStudio

Template Studio accelerates the creation of new WinUI 3, WPF, and UWP apps using a wizard-based experience.
Other
2.7k stars 460 forks source link

Feature Proposal: CortanaVoiceCommand/Cortana Skill #145

Open mrlacey opened 7 years ago

mrlacey commented 7 years ago

Having code to show how to easily set up launching the app with voice commands from Cortana would probably be very useful > V1.0 functionality to add. Thoughts?

jamesmcroft commented 7 years ago

I agree with this. Would recommend providing Cortana using the app service approach using background tasks.

Although won't this be replaced by the Cortana skills kit eventually?

crutkas commented 7 years ago

We were thinking this would be a Cortana Skill.

jamesmcroft commented 7 years ago

So now that I finally fully understand what Cortana Skills are doing, would we still like to consider this feature @crutkas? I think the main question is, where do we see Cortana features moving with it no longer being strictly tied to Windows.

crutkas commented 7 years ago

https://channel9.msdn.com/Events/Build/2017/P4114 is one way. I also think doing a direct line is something we should think about for cortana skills

what are you seeing maybe that i'm not.

mrlacey commented 7 years ago

Is this issue getting confused by the difference between launch commands (Cortana launches the app and passes information based on the search) and Cortana Skills (Cortana as an intermediary to a bot)?

jamesmcroft commented 7 years ago

I'm not sure if its a confusion. Understanding that Cortana is moving to other platforms and is no longer tied to Windows, is there point in having commands in your application when you can create a Cortana skill that has the ability to launch into your application and has a much richer experience?

mrlacey commented 7 years ago

I thought that the purpose of the issue was to add support for launching an app from Cortana. If the expectation is that Cortana Skills will be used to launch apps, won't this be via a URL launch and so be covered by #180 (intercepting launching a webpage) Or do we need a separate issue to consider adding a custom scheme/protocol?

As a UWP project doesn't it make sense we add the things that UWP apps can do and that includes Cortana Voice Commands.

crutkas commented 7 years ago

asking cortana skills team on best practices / a sample we can look at.

crutkas commented 7 years ago

The schema would be just like you would do if using protocol activation of a skill. ala myAwesomeApp://.....

Docs that has lots of examples of launching websites, apps, and other features here: https://docs.microsoft.com/en-us/cortana/tutorials/bot-skills/bot-entity-channel-data

See build demo. The sample is here: https://github.com/Microsoft/Cortana-Skills-Samples-Build-2017/tree/master/B8031

https://channel9.msdn.com/Events/Build/2017/B8030 https://channel9.msdn.com/Events/Build/2017/B8031

touseefbsb commented 7 years ago

this would be very useful for the future projects, so I guess it should be included ASAP

crutkas commented 7 years ago

Need scheme launch first #506 :)