[TVM Integration] Support TVM conversion with FP16 data type - Githubissues

dmlc / gluon-nlp

NLP made easy

https://nlp.gluon.ai/

Apache License 2.0

2.56k stars 538 forks source link

[TVM Integration] Support TVM conversion with FP16 data type #1510

Open sxjscience opened 3 years ago

sxjscience commented 3 years ago

Description

We fixed TVM integration in GluonNLP recently for fp32 dtype. However, we still do not support fp16 dtype. We should

[ ] Revise the test to add FP16: https://github.com/dmlc/gluon-nlp/blob/e8d4c8ae98ca87db9674adfd499d40e4b274455c/tests/test_models.py#L65-L77
[ ] Revise the benchmark to add TVM + FP16: https://github.com/dmlc/gluon-nlp/blob/e8d4c8ae98ca87db9674adfd499d40e4b274455c/scripts/benchmarks/benchmark_utils.py#L610-L623