Fix benchmark for TVM

[Cli212]

Description

This PR fixes the script which uses tvm to benchmark inference time.

Checklist

Essentials

• [ ] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
• [ ] Changes are complete (i.e. I finished coding on this PR)
• [ ] All changes have test coverage
• [ ] Code is well-documented

Changes

• [ ] Fix the usage of get_ec2_tvm_flags and update_tvm_convert_map.
• [ ] Use tvm time_evaluator to measure time costs of inference function.
• [ ] Add py3nvml to extra requirements.

cc @dmlc/gluon-nlp-team

[github-actions[bot]]

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1509/5b264625d7a2375f08e6c9299010a00470eae0e3/index.html

[codecov[bot]]

Codecov Report

Merging #1509 (3927b9b) into master (f44ec96) will increase coverage by 0.27%. The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1509      +/-   ##
==========================================
+ Coverage   86.35%   86.62%   +0.27%     
==========================================
  Files          54       55       +1     
  Lines        7388     7741     +353     
==========================================
+ Hits         6380     6706     +326     
- Misses       1008     1035      +27     

Impacted Files	Coverage Δ
setup.py	0.00% <ø> (ø)
src/gluonnlp/models/t5.py	92.74% <0.00%> (-0.92%)	:arrow_down:
src/gluonnlp/models/transformer.py	98.32% <0.00%> (-0.21%)	:arrow_down:
src/gluonnlp/models/__init__.py	100.00% <0.00%> (ø)
src/gluonnlp/models/mt5.py	95.49% <0.00%> (ø)

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update f44ec96...3927b9b. Read the comment docs.

[github-actions[bot]]

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1509/8eccee134ab6a0a4f936fd48a81ba131f8a49056/index.html

[github-actions[bot]]

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1509/3927b9b300dfdf968bc379f48516a4be44d0b602/index.html