search

nvidia-riva / riva-asrlib-decoder

Standalone implementation of the CUDA-accelerated WFST Decoder available in Riva
80 stars 23 forks source link

ONNX export #1

Closed jsvir closed 2 years ago

jsvir commented 2 years ago

Is it possible to export it to onnx? Are there other ways to run it on triton server?

messiaen commented 2 years ago

Triton does support onnx. This library performs wfst decoding directly on a ctc output logits, which can be generated however you want.

Riva supports ONNX models via NeMo.