Convert Ctranslate2 model to Pytorch or TorchScript or PyTorch Lightning

OpenNMT / CTranslate2

Fast inference engine for Transformer models

https://opennmt.net/CTranslate2

MIT License

3.26k stars 287 forks source link

Convert Ctranslate2 model to Pytorch or TorchScript or PyTorch Lightning #1762

Open aryan1165 opened 1 month ago

aryan1165 commented 1 month ago

I want to inference NMT model on android device and found this for demo android application using pytorch lightning. I have a pretrained NMT model which was converted to Ctranslate2 using OpenNMTPy converter. But now don't have access to .pt anymore.

Any ideas on how it could be done?