How possible to convert VALLE into TensorRT Engine?

Plachtaa / VALL-E-X

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/

MIT License

7.58k stars 756 forks source link

How possible to convert VALLE into TensorRT Engine? #170

Open ElinLiu0 opened 6 months ago

ElinLiu0 commented 6 months ago

Hi,i have seen that the basic model of VALLE doesn't implement forward() function,is that possible to just write infercen code into forward() function to make it possible to convert into ONNX first,and then convert into TensorRT Engine?