search

tue-robotics / tue_robocup

RoboCup challenge implementations
https://github.com/orgs/tue-robotics/projects/2
41 stars 12 forks source link

[Intermittent:] Dragonfly (the infamous speech bug) #882

Open ar13pit opened 5 years ago

ar13pit commented 5 years ago

Apart from the issues of HMI server, the bug is in our server interface of dragonfly speech recognition. The preempts are not being done correctly and a new request is overwriting the grammar before completion of the existing one.

MatthijsBurgh commented 5 years ago

https://github.com/tue-robotics/dragonfly_speech_recognition/issues/14

Rayman commented 5 years ago

The famous dragonfly bug where grammars can't be unloaded :(

MatthijsBurgh commented 5 years ago

The famous dragonfly bug where grammars can't be unloaded :(

Is it a bug in dragonfly itself? We could switch to a new version, https://github.com/tue-robotics/dragonfly_speech_recognition/issues/26, this could solve it, if it is in dragonfly.

Rayman commented 5 years ago

Dragonfly has COM bindings to the underlying windows speech service. Even when you unload the grammers, you still receive callbacks when things are heared by the WSR engine. Maybe this behavior is fixed in the new version?

Rayman commented 5 years ago

Maybe using a different engine, kaldi or dragon fixes it.

ar13pit commented 5 years ago

We could try with the new dragonfly and see if it is fixed.

DNS maybe a good alternative.

For Kaldi, we won't use dragonfly as we have already built our custom grammar loading and unloading functionality and it works. The only thing remaining in it is our customized model inference pipeline which needs a bit of work.