lostromb
commented
4 years ago Sure, see if this works for you. The API surface is still really rough and it has a lot of helper structs (Pointer<>, etc.) to make it behave like C. This looks really awkward in C# but it also means that you can use the regular C documentation and the functions/parameters should be analogous.
// Initialize sphinx config, including paths to model + dictionary files
Pointer<cmd_ln_t> config = PointerHelpers.Malloc<cmd_ln_t>(1);
config.Deref = new cmd_ln_t();
config = cmd_ln.cmd_ln_init(config, pocketsphinx.ps_args(), 1,
"-hmm", @"C:\Users\Administrator\Desktop\pocketsphinx-kws-master\CSharp\en-us-semi",
"-dict", @"C:\Users\Administrator\Desktop\pocketsphinx-kws-master\CSharp\cmudict_SPHINX_40.txt",
"-verbose", "y");
// I altered the original Sphinx code to allow for programmatically passing multiple keywords at once
// (where the original code only accepted either a single keyword, or a path to an external file containing multiple keywords).
// This is the format of the keyword string
string keywordFile =
"GO UP/3.1e-6\n" +
"GO LEFT/3.1e-6\n" +
"GO RIGHT/3.1e-6\n" +
"GO DOWN/3.1e-6\n";
// Initialize decoder struct
Pointer <ps_decoder_t> ps = pocketsphinx.ps_init(config);
// Set search mode
if (pocketsphinx.ps_set_kws(ps, cstring.ToCString("keyword_search"), cstring.ToCString(keywordFile)) != 0)
{
throw new Exception("Failed to set keyword search mode");
}
if (pocketsphinx.ps_set_search(ps, cstring.ToCString("keyword_search")) != 0)
{
throw new Exception("Failed to set keyword search mode");
}
// Tell decoder to prepare for some input audio
if (pocketsphinx.ps_start_utt(ps) != 0)
{
throw new Exception("Failed to start utterance");
}
bool user_is_speaking = false;
Pointer<byte> last_hyp = PointerHelpers.Malloc<byte>(512); // scratch buffer to hold the detected keyword
last_hyp[0] = 0;
// Send 10ms of audio at a time to decoder
const int SLICE_SIZE = 160;
Pointer<short> pointerToSamples = new Pointer<short>(inputAudioSamples);
for (int startOffset = 0; startOffset <= inputAudioSamples.Length - SLICE_SIZE; startOffset += SLICE_SIZE)
{
Console.WriteLine("Processing " + startOffset);
pocketsphinx.ps_process_raw(ps, pointerToSamples.Point(startOffset), SLICE_SIZE, 0, 0);
// And extract output
bool speech_detected = pocketsphinx.ps_get_in_speech(ps) != 0;
BoxedValueInt score = new BoxedValueInt();
Pointer<byte> hyp = pocketsphinx.ps_get_hyp(ps, score);
if (hyp.IsNonNull)
{
// A search hypothesis was found in the input audio. Extract it as a cstring and store it elsewhere
uint hypsize = cstring.strlen(hyp);
cstring.strncpy(last_hyp, hyp, hypsize);
last_hyp[hypsize] = 0;
Console.WriteLine("Keyword detected: " + cstring.FromCString(last_hyp));
}
if (!speech_detected && user_is_speaking)
{
Console.WriteLine("Speech -> silence transition");
// speech->silence transition, time to start new utterance
pocketsphinx.ps_end_utt(ps);
// get final hypothesis, if any
hyp = pocketsphinx.ps_get_hyp(ps, score);
if (hyp.IsNonNull)
{
uint hypsize = cstring.strlen(hyp);
cstring.strncpy(last_hyp, hyp, hypsize);
last_hyp[hypsize] = 0;
Console.WriteLine("Keyword detected: " + cstring.FromCString(last_hyp));
}
// and restart utterance
if (pocketsphinx.ps_start_utt(ps) != 0)
{
throw new Exception("Failed to start utterance");
}
user_is_speaking = false;
}
else
{
user_is_speaking = speech_detected;
}
}
CobraCalle
Hello,
I
m looking for a way to get pocketsphinx running on dotnet core on windows iot (and linux)... and now Ive found your c# port, that sounds like a good solution to my problem.Would it be possible to share a small sample on how to initialize the keyword spotter and process pcm data to spot a keyword?
That would really help... thank you very much for your great work
Carl