cardboardcode / epd_core

A ROS2 package that accelerates the training and deployment of CV models for industries.
Apache License 2.0
0 stars 0 forks source link

Dockerize Precision Level 3 training enviro. #4

Closed cardboardcode closed 2 years ago

cardboardcode commented 2 years ago

Managed to dockerize P3 Training Enviro. However, there are the following major caveats in its use:

  1. Its installation of maskrcnn_benchmark python dependency needs to be reinstalled for every individual new instantiation of the docker image on a new GPU system.

  2. The image is ~8GB big and requires trimming to improve portability.

  3. It is also observed that its use is facing stalling for an unknown reason where used for a different GPU system.

cardboardcode commented 2 years ago

Trainer docker image is deemed to not work due to incompatible .pth generated by torch==1.10.1 and torchvision==0.11.2.

The .pth generated is strangely of Archive Object Type, rather than Binary Object Type. Screenshot from 2022-03-13 17-45-35

Update as of (15th March 2022): Downgrading back to torch==1.2.0 and torchvision==0.4.0 resolved the issue.

cardboardcode commented 2 years ago

This issue is resolved with https://github.com/ros-industrial/easy_perception_deployment/pull/56. Closing.