search

shanecolb / sphinx-ue4

A speech recognition plugin for Unreal Engine 4. This is essentially a port of Pocketsphinx, to be used within an Unreal Engine project.
The Unlicense
150 stars 80 forks source link

Is getting support for Android still on the roadmap ? #16

Open motorsep opened 6 years ago

motorsep commented 6 years ago

It's been a while since my last post about Android support. I am still wondering if Android version is on the table and if so, when will it arrive ?

Thanks beforehand

shanecolb commented 6 years ago

Hello motorsep, I have been working on an Android port, I am actually sorting out a few remaining issues with the grammar mode. I should have a demo project out in the next few days. This was originally done as an exclusive for an interesting project , but that unfortunately fell through. =/ I had toyed with the idea of making it a paid plugin, but decided to make it open instead, and hope that some people donate if it's been helpful...it has been quite frustrating to get it working correctly through android. I`ll update this thread with links, when it is ready to be tested out.

motorsep commented 6 years ago

@shanecolb aaah, great news! I'd donate for it, for sure! Or I'd buy it on the Marketplace ;) (there are a lot of plugins that sell and have source code provided with the purchase)

shanecolb commented 6 years ago

Hello, I have posted a demo project (of the android speech recognition) of which you can try. https://forums.unrealengine.com/community/work-in-progress/1427459-plugin-speech-recognition-plugin-android-release Please try it out, and let me know on the thread, if you have any issues.

motorsep commented 6 years ago

@shanecolb

Nice one! Thanks a bunch. Btw, any chance for 4.19p4 binary build? My active project is on 4,19.. I don't have anything to test with in 4.17/4.18 :(

Does my project have to be C++ project or BP-only would do ?

shanecolb commented 6 years ago

Grab the 4.18 project, and try upgrading that to 4.19 and rebuilding the plugin. Often there's no changes necessary when upgrading UE major release. Although on the other hand 4.17 => 4.18 did require some tweaks to the plugin code. If this doesn't work, let me know, and i`ll update it with a 4.19 project as well.

I am pretty sure an empty skeleton C++ class is still required (as previously mentioned in my wiki), but I hadn't tested that out in the later unreal engine releases.

For now, please just try and get the demo project working, rather than trying to implement the plugin into your own project, Any number of things could potentially go wrong down that path.

motorsep commented 6 years ago

UE4 doesn't have microphone input on Android :(

shanecolb commented 6 years ago

It doesn't use UE4 for the microphone input, the pocketsphinx library is what obtains the microphone data, The same can be said for the Windows release as well.

motorsep commented 6 years ago

@shanecolb

I unpacked project, loaded 4.19pre5, opened project and got this:

https://pastebin.com/htBT8vVj

:(

FatCat1411 commented 6 years ago

Hello mate, thank for your work. I have download your project, and launch it with my phone. The project build and work fine, just that it can't detect any phrase nor sound. I am using your 4.19 version, and haven't change anything. Can you tell me did i miss any step? One more note, the app open without asking for any permission in order to use my phone input.