search

alumae / gst-kaldi-nnet2-online

GStreamer plugin around Kaldi's online neural network decoder
Apache License 2.0
185 stars 100 forks source link

Is there any intention to support also the cudadecoder in this gstreamer setting ? #91

Open RaniRaven opened 4 years ago

RaniRaven commented 4 years ago

It seems like there is no server at all supporting the cudadecoder, and this is the only thing which supports GPU now. It's a pitty, since the result could have been much faster with lower latency.

alumae commented 4 years ago

No, there are no plans to support CUDA. I just cannot see it as a very practical approach (one would need one GPU per worker, which would be expensive, and CPU decoding is already faster than real time in most cases).