Does CT2/OpenNMT engine support Qualcomm SoC?

OpenNMT / CTranslate2

Fast inference engine for Transformer models

https://opennmt.net/CTranslate2

MIT License

3.21k stars 282 forks source link

Open Weisonorz opened 3 months ago

Weisonorz commented 3 months ago

Is there any way to inference using CT2/OpenNMT engines on GPU/NPU of Android devices?

minhthuc2502 commented 3 months ago

No, CT2 does not support the NPUs yet.