Open vcorbit opened 3 years ago
waq1129
commented
3 years ago Hi videos_dgp should include all videos (labeled or not labeled). But you have to have some labeled frames input to DGP-labeled, as the ones you use for DLC. It seems like you have no labeled/visible frames at all. That's why it throws this error.
Best, Anqi
vcorbit
commented
3 years ago Hi Anqi,
Thanks for clarifying. Another clarification question - do ALL of my labeled videos need to be in that videos_dgp folder? I'm having trouble getting the DGP to finish running in my max time limit on our University server, so I thought I'd try to reduce the number of videos in that folder. However when I did that, I got this error:
Traceback (most recent call last):
File "/tigress/vcorbit/DGP/deepgraphpose/demo/run_dgp_demo.py", line 209, in
I'm pretty sure this came about because it's looking for a video that I have labels for, but I removed the actual video from videos_dgp. My DLC network has a total of ~1200 labeled frames across 42 videos, and so far I haven't been able to complete a run of DGP before my server job times out. Any advice you have for how to handle this large amount of data would be great! Maybe I just need to copy my DLC project folder and reduce the number of labels/videos for DGP to run in a timely manner?
waq1129
commented
3 years ago Hi
Is this missing video a labeled one or an unlabeled one?
vcorbit
commented
3 years ago The missing video was a labeled video.
Hi,
I'm trying to run DGP on some DLC-labeled data I have from a long time ago. My DLC version is not up to date, but I already have the project folder, labeled data, and I ran up to iteration-7 on the DLC network, last year.
When I try to run DGP, I get through to "Running DGP with labeled frames only" and this section:
Creating training datasets Selected additional 95 hidden frames Skipped 0 high motion energy (me) frames since in visible window or close to higher me hidden frame Selected additional 95 hidden frames Skipped 0 high motion energy (me) frames since in visible window or close to higher me hidden frame Selected additional 95 hidden frames Skipped 0 high motion energy (me) frames since in visible window or close to higher me hidden frame
Video: 2mt_drtop_concat_cropped has 0 visible frames selected; 95 hidden frames selected. Video: 2mt_b2279_concat_cropped has 0 visible frames selected; 95 hidden frames selected. Video: 2mt_c2293_concat_cropped has 0 visible frames selected; 95 hidden frames selected. n_hidden_frames_total 5985 n_visible_frames_total 0 n_frames_total 5985
But then I get this error:
Traceback (most recent call last): File "/tigress/vcorbit/DGP/deepgraphpose/demo/run_dgp_demo.py", line 209, in
step=1)
File "/tigress/vcorbit/DGP/deepgraphpose/src/deepgraphpose/models/fitdgp.py", line 390, in fit_dgp_labeledonly
loss, total_loss, total_loss_visible, placeholders = dgp_loss(data_batcher, dgp_cfg)
File "/tigress/vcorbit/DGP/deepgraphpose/src/deepgraphpose/models/fitdgp.py", line 885, in dgp_loss
limb_full = np.reshape(limb_full, [joint_loc_full.shape[0], 2, -1])
File "/home/vcorbit/.conda/envs/dgp/lib/python3.6/site-packages/numpy/core/fromnumeric.py", line 292, in reshape
return _wrapfunc(a, 'reshape', newshape, order=order)
File "/home/vcorbit/.conda/envs/dgp/lib/python3.6/site-packages/numpy/core/fromnumeric.py", line 56, in _wrapfunc
return getattr(obj, method)(*args, **kwds)
ValueError: cannot reshape array of size 0 into shape (0,2,newaxis)
So, I'm a bit confused by the instructions, should the videos I include in the videos_dgp folder for "test phase" be videos that already have DLC labels? Or can they be videos that the network has never seen?