Possible to integrate this as a Unity plugin and build to Android?

k2-fsa / sherpa-onnx

Speech-to-text, text-to-speech, speaker diarization, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, Raspberry Pi, RISC-V, x86_64 servers, websocket server/client, C/C++, Python, Kotlin, C#, Go, NodeJS, Java, Swift, Dart, JavaScript, Flutter, Object Pascal, Lazarus, Rust

https://k2-fsa.github.io/sherpa/onnx/index.html

Apache License 2.0

3.61k stars 424 forks source link

Possible to integrate this as a Unity plugin and build to Android? #796

Open MarsMV opened 7 months ago

MarsMV commented 7 months ago

Desperately looking for TTS that can be used in Unity and built to Android that supports my native language. So far the Piper models are the only local TTS that supports my local language I've found, but I've had no success trying to run the python library directly on Android via Unity. I can get it to work in the editor, but not in a built .apk

Since this project has C# and .net support, is there any chance of this working within Unity for Android?

csukuangfj commented 6 months ago

I have heard that users have successfully integrated sherpa-onnx in Unity, though I don't how they did it.