open-mmlab / mmdeploy

OpenMMLab Model Deployment Framework
https://mmdeploy.readthedocs.io/en/latest/
Apache License 2.0
2.79k stars 636 forks source link

Is there an example of the entire pipeline in deploying the model on jetson nx? #1097

Open lb-hit opened 2 years ago

lb-hit commented 2 years ago

For example, from a model trained on a workstation to a model deployed on jetson.

  1. how to package the trained model on the workstation via mmdeploy.
  2. how to transfer to jetson.
  3. how to deploy and run on jetson.
tpoisonooo commented 2 years ago

@lvhan028

lvhan028 commented 2 years ago

You can refer to this guide: https://mmdeploy.readthedocs.io/en/latest/01-how-to-build/jetsons.html

lb-hit commented 2 years ago

@lvhan028 @tpoisonooo Hello, I have visited that link before. The link seems to say only how to install mmdeploy on jetson and the pre-installation preparation (JetPack SDK, Conda, PyTorch, CMake, TensorRT, MMCV, ONNX). And in another link (https://mmdeploy.readthedocs.io/zh_CN/latest/get_started.html), it seems to say only how to install MMDeploy in workstation. So after reading it, I don't really know how the pipeline works.

lvhan028 commented 2 years ago

get_started is limited to getting started on PC or Server. Regarding jetson, https://mmdeploy.readthedocs.io/en/latest/01-how-to-build/jetsons.html is the actual getting started. It presents:

lb-hit commented 2 years ago

@lvhan028 Hello, I would like to ask you again.

  1. So if I have a jetson card, I don't need to install mmdeploy on my PC? Just install it directly on jetson?
  2. What is the reason for installing on PC? Is it because the model is too big to train on jetson?
lb-hit commented 2 years ago

a3482a21b33133e657375d04e75246d @lvhan028 Hello, I am getting an error that the version does not meet the requirements (cmake>=3.1) when installing mmcv on Jetson NX. How should I fix this? (Already installed cmake v3.23.1, follow the link https://mmdeploy.readthedocs.io/en/latest/01-how-to-build/jetsons.html )

lb-hit commented 2 years ago

60bb62885004800a5691b12eae14ceb @lvhan028 Hello, I got another error when installing onnx on Jetson NX, how can I fix it?

lb-hit commented 2 years ago

dc7473339f2d9062ee6930dedb3183c @lvhan028 Hello, I got another error when installing h5py and pycuda on Jetson NX, how can I fix it? Thanks!