Hello guys, I wrote a streaming inference pipeline in Python for this project, including torch jit script, int8 dynamic quantization, and streaming interface for the audio encoder and decoder (style vector is pre-generated and worked as an embedding input while inference).
If interested, please comment, and I will make a MR.
Hello guys, I wrote a streaming inference pipeline in Python for this project, including torch jit script, int8 dynamic quantization, and streaming interface for the audio encoder and decoder (style vector is pre-generated and worked as an embedding input while inference). If interested, please comment, and I will make a MR.