search

NVIDIA / DIGITS

Deep Learning GPU Training System
https://developer.nvidia.com/digits
BSD 3-Clause "New" or "Revised" License
4.12k stars 1.38k forks source link

Error code 1 #1943

Open Wenyu1024 opened 6 years ago

Wenyu1024 commented 6 years ago

Hi, I am new to DIGITS and although I didn't encounter problem using example data, I kept getting ERROR CODE 1 when trainning on my custom data. I can successfully change my Kitti form label data and 1280*1024 data into LMDB. But when I started training I got this problem.

One thing I need to mention is previously I neglected setting "custom class" in data generation interface and training based on that data seems can finish the training, although due to the wrong label the network didn't learn anything. And now the custom class blank are filled with dont'care, cell. Which is exactly the class I have in my label files. I used lowerclass in both label files and in filling the interface blank.

Any idea about how I can solve this? Many thank!

Wenyu1024 commented 6 years ago

P.S: information from caffe_output.log that might be useful: libdc1394 error: Failed to initialize libdc1394 ... ... Traceback (most recent call last): File "/usr/local/python/caffe/layers/detectnet/clustering.py", line 66, in forward bbox = cluster(self, data0, bottom[1].data) File "/usr/local/python/caffe/layers/detectnet/clustering.py", line 232, in cluster boxes[i, 0:r, 0:c] = boxes_cur_image ValueError: could not broadcast input array from shape (98,4) into shape (50,4)

I just found possible solution in #1235. Thanks!