Open DanielVlasic opened 5 years ago
Looks like one of the masks might be empty, one of the logs may be corrupted. Could you post the full error message? In general training the shoes can be done in the same way as the caterpillar in the tutorial if you want a class-consistent shoe network.
For some of the code used in the shoe experiments you can take a look at https://github.com/RobotLocomotion/pytorch-dense-correspondence/blob/master/dense_correspondence/experiments/shoes_consistent/training_shoes.ipynb.
Here are some details.
I executed the tutorial: dense_correspondence/training/training_tutorial.ipynb.
I set the config to: config_filename = os.path.join(utils.getDenseCorrespondenceSourceDir(), 'config', 'dense_correspondence', 'dataset', 'composite', 'shoes_all.yaml')
Here is the full output of the training cell:
training descriptor of dimension 3 using SINGLE_OBJECT_WITHIN_SCENE logging_dir: /home/dvlasic/data/pdc/trained_models/tutorials/shoes_3 Downloading: "https://download.pytorch.org/models/resnet34-333f7ec4.pth" to /home/dvlasic/.cache/torch/checkpoints/resnet34-333f7ec4.pth 100.0% /usr/local/lib/python2.7/dist-packages/torch/nn/functional.py:2622: UserWarning: nn.functional.upsample_bilinear is deprecated. Use nn.functional.interpolate instead. warnings.warn("nn.functional.upsample_bilinear is deprecated. Use nn.functional.interpolate instead.") /home/dvlasic/code/modules/dense_correspondence_manipulation/utils/utils.py:258: RuntimeWarning: invalid value encountered in arccos theta = 2np.arccos(2 np.dot(q,r)2 - 1) /home/dvlasic/code/modules/dense_correspondence_manipulation/utils/utils.py:258: RuntimeWarning: invalid value encountered in arccos theta = 2np.arccos(2 np.dot(q,r)2 - 1)
empty data, continuing
/home/dvlasic/code/modules/dense_correspondence_manipulation/utils/utils.py:258: RuntimeWarning: invalid value encountered in arccos theta = 2np.arccos(2 np.dot(q,r)**2 - 1)
empty data, continuing
empty data, continuing
empty data, continuing
ZeroDivisionError Traceback (most recent call last)
Thanks, I can fix this
Hi Daniel, sorry to be so slow. Does this commit fix your issue? https://github.com/RobotLocomotion/pytorch-dense-correspondence/commit/ad541fca840f8a07c2bd42b08564bd645341faa8 We have fixed this issue in our private branch, I think this should be all you need. Let me know if doesn't work.
Also I am working on getting the new code open sourced, should be soon.
I downloaded the shoe data (https://github.com/RobotLocomotion/pytorch-dense-correspondence/blob/master/config/dense_correspondence/dataset/composite/shoes_all.yaml) and tried going through the tutorial training with it.
I've received a "warning, empty mask b”, followed by “float division by zero” error.
Also, not sure which training config is appropriate for the shoe data.