search

FORTH-ModelBasedTracker / MocapNET

We present MocapNET, a real-time method that estimates the 3D human pose directly in the popular Bio Vision Hierarchy (BVH) format, given estimations of the 2D body joints originating from monocular color images. Our contributions include: (a) A novel and compact 2D pose NSRM representation. (b) A human body orientation classifier and an ensemble of orientation-tuned neural networks that regress the 3D human pose by also allowing for the decomposition of the body to an upper and lower kinematic hierarchy. This permits the recovery of the human pose even in the case of significant occlusions. (c) An efficient Inverse Kinematics solver that refines the neural-network-based solution providing 3D human pose estimations that are consistent with the limb sizes of a target person (if known). All the above yield a 33% accuracy improvement on the Human 3.6 Million (H3.6M) dataset compared to the baseline method (MocapNET) while maintaining real-time performance
https://www.youtube.com/watch?v=Jgz1MRq-I-k
Other
858 stars 137 forks source link

Demo not working on Google Colab #33

Closed PiotrMi closed 4 years ago

PiotrMi commented 4 years ago

Tried on a GPU runtime

Colab link: https://colab.research.google.com/drive/19UM6NAcmEeUUbSkjlJniWSs9bc4V-c4s?usp=sharing

Command:

./MocapNET2LiveWebcamDemo --from shuffle.webm --openpose --frames 375 --delay 1000 --novisualization

Output:

CPU :  Intel(R) Xeon(R) CPU @ 2.00GHz
sh: 1: lspci: not found
GPU : 
Trying to open source (shuffle.webm) 
Using BVH codebase version 0.43
buildOpenGLProjectionForIntrinsics: img(1920x1080) fx 582.18, fy 582.53, cx 960.00, cy 540.00

Number of Values Per Frame: 498
Frames: 1(1) / Frame Time : 0.0400
BVH subsystem initialized using dataset/headerWithHeadAndOneMotion.bvh that contains 1 frames ( 498 motions each )
Initializing IK code..
Body Problem : 

The IK problem we want to solve has 2 groups of subproblems
It is also ultimately divided into 7 kinematic chains
Chain 0 has 8 parts : jID(hip/0)->mID(0 to 2) jID(hip/0)->mID(3 to 5) jID(neck/3)->EndEffector jID(head/5)->EndEffector jID(rShldr/105)->EndEffector jID(lShldr/136)->EndEffector jID(rThigh/167)->EndEffector jID(lThigh/190)->EndEffector 
Chain 1 has 4 parts : jID(chest/2)->mID(9 to 11) jID(neck/3)->EndEffector jID(rShldr/105)->EndEffector jID(lForeArm/137)->EndEffector 
Chain 2 has 5 parts : jID(neck/3)->mID(12 to 14) jID(neck1/4)->mID(15 to 17) jID(head/5)->mID(18 to 20) jID(eye.l/70)->EndEffector jID(eye.r/78)->EndEffector 
Chain 3 has 3 parts : jID(rShldr/105)->mID(237 to 239) jID(rForeArm/106)->mID(240 to 242) jID(rHand/107)->EndEffector 
Chain 4 has 3 parts : jID(lShldr/136)->mID(315 to 317) jID(lForeArm/137)->mID(318 to 320) jID(lHand/138)->EndEffector 
Chain 5 has 5 parts : jID(rThigh/167)->mID(393 to 395) jID(rShin/168)->mID(396 to 398) jID(rFoot/169)->mID(399 to 401) jID(EndSite_toe1-2.R/172)->EndEffector jID(EndSite_toe5-3.R/188)->EndEffector 
Chain 6 has 5 parts : jID(lThigh/190)->mID(447 to 449) jID(lShin/191)->mID(450 to 452) jID(lFoot/192)->mID(453 to 455) jID(EndSite_toe1-2.L/195)->EndEffector jID(EndSite_toe5-3.L/211)->EndEffector 
BVH code initalization successfull..
Trying to set thread realtime prio = 99 
Failed setting thread realtime priority
LoadGraph dataset/combinedModel/openpose_model.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/openpose_model.pb
Tensor: input_1 inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/openpose_model.pb
Tensor: k2tfout_1 inputs: 1
 outputs: 1
2020-10-15 14:35:58.222583: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 AVX512F FMA
2020-10-15 14:35:58.227891: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2000140000 Hz
2020-10-15 14:35:58.228125: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x557bd7267f80 executing computations on platform Host. Devices:
2020-10-15 14:35:58.228159: I tensorflow/compiler/xla/service/service.cc:175]   StreamExecutor device (0): <undefined>, <undefined>
2020-10-15 14:35:58.229927: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcuda.so.1
2020-10-15 14:35:58.254401: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1005] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-15 14:35:58.255191: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1640] Found device 0 with properties: 
name: Tesla P4 major: 6 minor: 1 memoryClockRate(GHz): 1.1135
pciBusID: 0000:00:04.0
2020-10-15 14:35:58.255727: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcudart.so.10.0
2020-10-15 14:35:58.257197: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcublas.so.10.0
2020-10-15 14:35:58.258389: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcufft.so.10.0
2020-10-15 14:35:58.258814: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcurand.so.10.0
2020-10-15 14:35:58.260154: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcusolver.so.10.0
2020-10-15 14:35:58.261347: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcusparse.so.10.0
2020-10-15 14:35:58.264441: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcudnn.so.7
2020-10-15 14:35:58.264549: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1005] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-15 14:35:58.265225: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1005] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-15 14:35:58.265830: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1763] Adding visible gpu devices: 0
2020-10-15 14:35:58.265891: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcudart.so.10.0
2020-10-15 14:35:58.353876: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:35:58.353919: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      0 
2020-10-15 14:35:58.353933: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1200] 0:   N 
2020-10-15 14:35:58.354113: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1005] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-15 14:35:58.354554: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1005] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-15 14:35:58.354981: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1005] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2020-10-15 14:35:58.355325: W tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:40] Overriding allow_growth setting because the TF_FORCE_GPU_ALLOW_GROWTH environment variable is set. Original config value was 0.
2020-10-15 14:35:58.355367: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1326] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7123 MB memory) -> physical GPU (device: 0, name: Tesla P4, pci bus id: 0000:00:04.0, compute capability: 6.1)
MocapNET2 Initializing..
Trying to set thread realtime prio = 99 
Failed setting thread realtime priority
Map will be initialized from file  
Initializing from  .. 
 artifacts ok
Loading Gesture 0 -> dataset/gestures/help.bvh  : 
Number of Values Per Frame: 498
Frames: 63(63) / Frame Time : 0.0400
Gesture dataset/gestures/help.bvh has 63 frames with 498 fields each
Joint 7/abdomen_Xrotation is going to be used for gesture #0
Joint 8/abdomen_Yrotation is going to be used for gesture #0
Joint 12/neck_Zrotation is going to be used for gesture #0
Joint 13/neck_Xrotation is going to be used for gesture #0
Joint 14/neck_Yrotation is going to be used for gesture #0
Joint 15/neck1_Zrotation is going to be used for gesture #0
Joint 16/neck1_Xrotation is going to be used for gesture #0
Joint 17/neck1_Yrotation is going to be used for gesture #0
Joint 18/head_Zrotation is going to be used for gesture #0
Joint 19/head_Xrotation is going to be used for gesture #0
Joint 20/head_Yrotation is going to be used for gesture #0
Joint 21/__jaw_Zrotation is going to be used for gesture #0
Joint 22/__jaw_Xrotation is going to be used for gesture #0
Joint 24/jaw_Zrotation is going to be used for gesture #0
Joint 25/jaw_Xrotation is going to be used for gesture #0
Joint 26/jaw_Yrotation is going to be used for gesture #0
Joint 27/special04_Zrotation is going to be used for gesture #0
Joint 28/special04_Xrotation is going to be used for gesture #0
Joint 29/special04_Yrotation is going to be used for gesture #0
Joint 30/oris02_Zrotation is going to be used for gesture #0
Joint 31/oris02_Xrotation is going to be used for gesture #0
Joint 32/oris02_Yrotation is going to be used for gesture #0
Joint 33/oris01_Zrotation is going to be used for gesture #0
Joint 34/oris01_Xrotation is going to be used for gesture #0
Joint 35/oris01_Yrotation is going to be used for gesture #0
Joint 36/oris06.l_Zrotation is going to be used for gesture #0
Joint 37/oris06.l_Xrotation is going to be used for gesture #0
Joint 38/oris06.l_Yrotation is going to be used for gesture #0
Joint 40/oris07.l_Xrotation is going to be used for gesture #0
Joint 41/oris07.l_Yrotation is going to be used for gesture #0
Joint 44/oris06.r_Yrotation is going to be used for gesture #0
Joint 45/oris07.r_Zrotation is going to be used for gesture #0
Joint 46/oris07.r_Xrotation is going to be used for gesture #0
Joint 47/oris07.r_Yrotation is going to be used for gesture #0
Joint 48/tongue00_Zrotation is going to be used for gesture #0
Joint 49/tongue00_Xrotation is going to be used for gesture #0
Joint 50/tongue00_Yrotation is going to be used for gesture #0
Joint 51/tongue01_Zrotation is going to be used for gesture #0
Joint 52/tongue01_Xrotation is going to be used for gesture #0
Joint 54/tongue02_Zrotation is going to be used for gesture #0
Joint 55/tongue02_Xrotation is going to be used for gesture #0
Joint 56/tongue02_Yrotation is going to be used for gesture #0
Joint 57/tongue03_Zrotation is going to be used for gesture #0
Joint 58/tongue03_Xrotation is going to be used for gesture #0
Joint 59/tongue03_Yrotation is going to be used for gesture #0
Joint 60/__tongue04_Zrotation is going to be used for gesture #0
Joint 61/__tongue04_Xrotation is going to be used for gesture #0
Joint 62/__tongue04_Yrotation is going to be used for gesture #0
Joint 63/tongue04_Zrotation is going to be used for gesture #0
Joint 64/tongue04_Xrotation is going to be used for gesture #0
Joint 65/tongue04_Yrotation is going to be used for gesture #0
Joint 66/tongue07.l_Zrotation is going to be used for gesture #0
Joint 67/tongue07.l_Xrotation is going to be used for gesture #0
Joint 68/tongue07.l_Yrotation is going to be used for gesture #0
Joint 70/tongue07.r_Xrotation is going to be used for gesture #0
Joint 71/tongue07.r_Yrotation is going to be used for gesture #0
Joint 74/tongue06.l_Yrotation is going to be used for gesture #0
Joint 75/tongue06.r_Zrotation is going to be used for gesture #0
Joint 76/tongue06.r_Xrotation is going to be used for gesture #0
Joint 77/tongue06.r_Yrotation is going to be used for gesture #0
Joint 78/tongue05.l_Zrotation is going to be used for gesture #0
Joint 79/tongue05.l_Xrotation is going to be used for gesture #0
Joint 80/tongue05.l_Yrotation is going to be used for gesture #0
Joint 81/tongue05.r_Zrotation is going to be used for gesture #0
Joint 82/tongue05.r_Xrotation is going to be used for gesture #0
Joint 84/__levator02.l_Zrotation is going to be used for gesture #0
Joint 85/__levator02.l_Xrotation is going to be used for gesture #0
Joint 86/__levator02.l_Yrotation is going to be used for gesture #0
Joint 88/levator02.l_Xrotation is going to be used for gesture #0
Joint 91/levator03.l_Xrotation is going to be used for gesture #0
Joint 93/levator04.l_Zrotation is going to be used for gesture #0
Joint 94/levator04.l_Xrotation is going to be used for gesture #0
Joint 95/levator04.l_Yrotation is going to be used for gesture #0
Joint 96/levator05.l_Zrotation is going to be used for gesture #0
Joint 97/levator05.l_Xrotation is going to be used for gesture #0
Joint 98/levator05.l_Yrotation is going to be used for gesture #0
Joint 100/__levator02.r_Xrotation is going to be used for gesture #0
Joint 101/__levator02.r_Yrotation is going to be used for gesture #0
Joint 104/levator02.r_Yrotation is going to be used for gesture #0
Joint 105/levator03.r_Zrotation is going to be used for gesture #0
Joint 106/levator03.r_Xrotation is going to be used for gesture #0
Joint 107/levator03.r_Yrotation is going to be used for gesture #0
Joint 108/levator04.r_Zrotation is going to be used for gesture #0
Joint 109/levator04.r_Xrotation is going to be used for gesture #0
Joint 110/levator04.r_Yrotation is going to be used for gesture #0
Joint 111/levator05.r_Zrotation is going to be used for gesture #0
Joint 112/levator05.r_Xrotation is going to be used for gesture #0
Joint 113/levator05.r_Yrotation is going to be used for gesture #0
Joint 114/__special01_Zrotation is going to be used for gesture #0
Joint 115/__special01_Xrotation is going to be used for gesture #0
Joint 116/__special01_Yrotation is going to be used for gesture #0
Joint 118/special01_Xrotation is going to be used for gesture #0
Joint 121/oris04.l_Xrotation is going to be used for gesture #0
Joint 123/oris03.l_Zrotation is going to be used for gesture #0
Joint 124/oris03.l_Xrotation is going to be used for gesture #0
Joint 125/oris03.l_Yrotation is going to be used for gesture #0
Joint 126/oris04.r_Zrotation is going to be used for gesture #0
Joint 127/oris04.r_Xrotation is going to be used for gesture #0
Joint 128/oris04.r_Yrotation is going to be used for gesture #0
Joint 130/oris03.r_Xrotation is going to be used for gesture #0
Joint 131/oris03.r_Yrotation is going to be used for gesture #0
Joint 134/oris06_Yrotation is going to be used for gesture #0
Joint 135/oris05_Zrotation is going to be used for gesture #0
Joint 136/oris05_Xrotation is going to be used for gesture #0
Joint 137/oris05_Yrotation is going to be used for gesture #0
Joint 138/__special03_Zrotation is going to be used for gesture #0
Joint 139/__special03_Xrotation is going to be used for gesture #0
Joint 140/__special03_Yrotation is going to be used for gesture #0
Joint 141/special03_Zrotation is going to be used for gesture #0
Joint 142/special03_Xrotation is going to be used for gesture #0
Joint 143/special03_Yrotation is going to be used for gesture #0
Joint 144/__levator06.l_Zrotation is going to be used for gesture #0
Joint 145/__levator06.l_Xrotation is going to be used for gesture #0
Joint 146/__levator06.l_Yrotation is going to be used for gesture #0
Joint 148/levator06.l_Xrotation is going to be used for gesture #0
Joint 150/__levator06.r_Zrotation is going to be used for gesture #0
Joint 151/__levator06.r_Xrotation is going to be used for gesture #0
Joint 152/__levator06.r_Yrotation is going to be used for gesture #0
Joint 153/levator06.r_Zrotation is going to be used for gesture #0
Joint 154/levator06.r_Xrotation is going to be used for gesture #0
Joint 155/levator06.r_Yrotation is going to be used for gesture #0
Joint 156/special06.l_Zrotation is going to be used for gesture #0
Joint 157/special06.l_Xrotation is going to be used for gesture #0
Joint 158/special06.l_Yrotation is going to be used for gesture #0
Joint 160/special05.l_Xrotation is going to be used for gesture #0
Joint 161/special05.l_Yrotation is going to be used for gesture #0
Joint 164/eye.l_Yrotation is going to be used for gesture #0
Joint 169/orbicularis04.l_Xrotation is going to be used for gesture #0
Joint 170/orbicularis04.l_Yrotation is going to be used for gesture #0
Joint 171/special06.r_Zrotation is going to be used for gesture #0
Joint 172/special06.r_Xrotation is going to be used for gesture #0
Joint 173/special06.r_Yrotation is going to be used for gesture #0
Joint 174/special05.r_Zrotation is going to be used for gesture #0
Joint 175/special05.r_Xrotation is going to be used for gesture #0
Joint 176/special05.r_Yrotation is going to be used for gesture #0
Joint 178/eye.r_Xrotation is going to be used for gesture #0
Joint 180/orbicularis03.r_Zrotation is going to be used for gesture #0
Joint 181/orbicularis03.r_Xrotation is going to be used for gesture #0
Joint 182/orbicularis03.r_Yrotation is going to be used for gesture #0
Joint 183/orbicularis04.r_Zrotation is going to be used for gesture #0
Joint 184/orbicularis04.r_Xrotation is going to be used for gesture #0
Joint 185/orbicularis04.r_Yrotation is going to be used for gesture #0
Joint 186/__temporalis01.l_Zrotation is going to be used for gesture #0
Joint 187/__temporalis01.l_Xrotation is going to be used for gesture #0
Joint 188/__temporalis01.l_Yrotation is going to be used for gesture #0
Joint 189/temporalis01.l_Zrotation is going to be used for gesture #0
Joint 190/temporalis01.l_Xrotation is going to be used for gesture #0
Joint 191/temporalis01.l_Yrotation is going to be used for gesture #0
Joint 193/oculi02.l_Xrotation is going to be used for gesture #0
Joint 196/oculi01.l_Xrotation is going to be used for gesture #0
Joint 197/oculi01.l_Yrotation is going to be used for gesture #0
Joint 200/__temporalis01.r_Yrotation is going to be used for gesture #0
Joint 201/temporalis01.r_Zrotation is going to be used for gesture #0
Joint 202/temporalis01.r_Xrotation is going to be used for gesture #0
Joint 203/temporalis01.r_Yrotation is going to be used for gesture #0
Joint 204/oculi02.r_Zrotation is going to be used for gesture #0
Joint 205/oculi02.r_Xrotation is going to be used for gesture #0
Joint 206/oculi02.r_Yrotation is going to be used for gesture #0
Joint 207/oculi01.r_Zrotation is going to be used for gesture #0
Joint 208/oculi01.r_Xrotation is going to be used for gesture #0
Joint 210/__temporalis02.l_Zrotation is going to be used for gesture #0
Joint 211/__temporalis02.l_Xrotation is going to be used for gesture #0
Joint 212/__temporalis02.l_Yrotation is going to be used for gesture #0
Joint 213/temporalis02.l_Zrotation is going to be used for gesture #0
Joint 214/temporalis02.l_Xrotation is going to be used for gesture #0
Joint 215/temporalis02.l_Yrotation is going to be used for gesture #0
Joint 216/risorius02.l_Zrotation is going to be used for gesture #0
Joint 217/risorius02.l_Xrotation is going to be used for gesture #0
Joint 218/risorius02.l_Yrotation is going to be used for gesture #0
Joint 219/risorius03.l_Zrotation is going to be used for gesture #0
Joint 220/risorius03.l_Xrotation is going to be used for gesture #0
Joint 221/risorius03.l_Yrotation is going to be used for gesture #0
Joint 222/__temporalis02.r_Zrotation is going to be used for gesture #0
Joint 223/__temporalis02.r_Xrotation is going to be used for gesture #0
Joint 224/__temporalis02.r_Yrotation is going to be used for gesture #0
Joint 225/temporalis02.r_Zrotation is going to be used for gesture #0
Joint 226/temporalis02.r_Xrotation is going to be used for gesture #0
Joint 227/temporalis02.r_Yrotation is going to be used for gesture #0
Joint 230/risorius02.r_Yrotation is going to be used for gesture #0
Joint 231/risorius03.r_Zrotation is going to be used for gesture #0
Joint 232/risorius03.r_Xrotation is going to be used for gesture #0
Joint 233/risorius03.r_Yrotation is going to be used for gesture #0
Joint 234/rcollar_Zrotation is going to be used for gesture #0
Joint 235/rcollar_Xrotation is going to be used for gesture #0
Joint 236/rcollar_Yrotation is going to be used for gesture #0
Joint 237/rshoulder_Zrotation is going to be used for gesture #0
Joint 238/rshoulder_Xrotation is going to be used for gesture #0
Joint 239/rshoulder_Yrotation is going to be used for gesture #0
Joint 240/relbow_Zrotation is going to be used for gesture #0
Joint 241/relbow_Xrotation is going to be used for gesture #0
Joint 242/relbow_Yrotation is going to be used for gesture #0
Joint 243/rhand_Zrotation is going to be used for gesture #0
Joint 244/rhand_Xrotation is going to be used for gesture #0
Joint 245/rhand_Yrotation is going to be used for gesture #0
Joint 313/lcollar_Xrotation is going to be used for gesture #0
Joint 315/lshoulder_Zrotation is going to be used for gesture #0
Joint 316/lshoulder_Xrotation is going to be used for gesture #0
Joint 317/lshoulder_Yrotation is going to be used for gesture #0
Joint 318/lelbow_Zrotation is going to be used for gesture #0
Joint 319/lelbow_Xrotation is going to be used for gesture #0
Joint 320/lelbow_Yrotation is going to be used for gesture #0
Joint 322/lhand_Xrotation is going to be used for gesture #0
Joint 323/lhand_Yrotation is going to be used for gesture #0
Joint 392/rbuttock_Yrotation is going to be used for gesture #0
Joint 393/rhip_Zrotation is going to be used for gesture #0
Joint 394/rhip_Xrotation is going to be used for gesture #0
Joint 395/rhip_Yrotation is going to be used for gesture #0
Joint 396/rknee_Zrotation is going to be used for gesture #0
Joint 397/rknee_Xrotation is going to be used for gesture #0
Joint 398/rknee_Yrotation is going to be used for gesture #0
Joint 399/rfoot_Zrotation is going to be used for gesture #0
Joint 400/rfoot_Xrotation is going to be used for gesture #0
Joint 401/rfoot_Yrotation is going to be used for gesture #0
Joint 444/lbuttock_Zrotation is going to be used for gesture #0
Joint 445/lbuttock_Xrotation is going to be used for gesture #0
Joint 446/lbuttock_Yrotation is going to be used for gesture #0
Joint 448/lhip_Xrotation is going to be used for gesture #0
Joint 450/lknee_Zrotation is going to be used for gesture #0
Joint 451/lknee_Xrotation is going to be used for gesture #0
Joint 452/lknee_Yrotation is going to be used for gesture #0
Joint 453/lfoot_Zrotation is going to be used for gesture #0
Joint 454/lfoot_Xrotation is going to be used for gesture #0
Joint 455/lfoot_Yrotation is going to be used for gesture #0
Success , loaded 63 frames
Loading Gesture 1 -> dataset/gestures/push.bvh  : 
Number of Values Per Frame: 498
Frames: 46(46) / Frame Time : 0.0400
Gesture dataset/gestures/push.bvh has 46 frames with 498 fields each
Joint 237/rshoulder_Zrotation is going to be used for gesture #1
Joint 238/rshoulder_Xrotation is going to be used for gesture #1
Joint 239/rshoulder_Yrotation is going to be used for gesture #1
Joint 240/relbow_Zrotation is going to be used for gesture #1
Joint 241/relbow_Xrotation is going to be used for gesture #1
Joint 242/relbow_Yrotation is going to be used for gesture #1
Joint 315/lshoulder_Zrotation is going to be used for gesture #1
Joint 316/lshoulder_Xrotation is going to be used for gesture #1
Joint 317/lshoulder_Yrotation is going to be used for gesture #1
Joint 318/lelbow_Zrotation is going to be used for gesture #1
Joint 319/lelbow_Xrotation is going to be used for gesture #1
Joint 320/lelbow_Yrotation is going to be used for gesture #1
Success , loaded 46 frames
Loading Gesture 2 -> dataset/gestures/lefthandcircle.bvh  : 
Number of Values Per Frame: 498
Frames: 29(29) / Frame Time : 0.0400
Gesture dataset/gestures/lefthandcircle.bvh has 29 frames with 498 fields each
Joint 315/lshoulder_Zrotation is going to be used for gesture #2
Joint 316/lshoulder_Xrotation is going to be used for gesture #2
Joint 317/lshoulder_Yrotation is going to be used for gesture #2
Joint 318/lelbow_Zrotation is going to be used for gesture #2
Joint 319/lelbow_Xrotation is going to be used for gesture #2
Joint 320/lelbow_Yrotation is going to be used for gesture #2
Success , loaded 29 frames
Loading Gesture 3 -> dataset/gestures/righthandcircle.bvh  : 
Number of Values Per Frame: 498
Frames: 40(40) / Frame Time : 0.0400
Gesture dataset/gestures/righthandcircle.bvh has 40 frames with 498 fields each
Joint 237/rshoulder_Zrotation is going to be used for gesture #3
Joint 238/rshoulder_Xrotation is going to be used for gesture #3
Joint 239/rshoulder_Yrotation is going to be used for gesture #3
Joint 240/relbow_Zrotation is going to be used for gesture #3
Joint 241/relbow_Xrotation is going to be used for gesture #3
Joint 242/relbow_Yrotation is going to be used for gesture #3
Success , loaded 40 frames
Loading Gesture 4 -> dataset/gestures/waveleft.bvh  : 
Number of Values Per Frame: 498
Frames: 27(27) / Frame Time : 0.0400
Gesture dataset/gestures/waveleft.bvh has 27 frames with 498 fields each
Joint 316/lshoulder_Xrotation is going to be used for gesture #4
Joint 317/lshoulder_Yrotation is going to be used for gesture #4
Joint 319/lelbow_Xrotation is going to be used for gesture #4
Joint 320/lelbow_Yrotation is going to be used for gesture #4
Success , loaded 27 frames
Loading Gesture 5 -> dataset/gestures/doubleclap.bvh  : 
Number of Values Per Frame: 498
Frames: 22(22) / Frame Time : 0.0400
Gesture dataset/gestures/doubleclap.bvh has 22 frames with 498 fields each
Joint 238/rshoulder_Xrotation is going to be used for gesture #5
Joint 239/rshoulder_Yrotation is going to be used for gesture #5
Joint 241/relbow_Xrotation is going to be used for gesture #5
Joint 242/relbow_Yrotation is going to be used for gesture #5
Joint 316/lshoulder_Xrotation is going to be used for gesture #5
Joint 317/lshoulder_Yrotation is going to be used for gesture #5
Joint 319/lelbow_Xrotation is going to be used for gesture #5
Joint 320/lelbow_Yrotation is going to be used for gesture #5
Success , loaded 22 frames
Loading Gesture 6 -> dataset/gestures/waveright.bvh  : 
Number of Values Per Frame: 498
Frames: 19(19) / Frame Time : 0.0400
Gesture dataset/gestures/waveright.bvh has 19 frames with 498 fields each
Joint 238/rshoulder_Xrotation is going to be used for gesture #6
Joint 239/rshoulder_Yrotation is going to be used for gesture #6
Joint 241/relbow_Xrotation is going to be used for gesture #6
Joint 242/relbow_Yrotation is going to be used for gesture #6
Success , loaded 19 frames
Loading Gesture 7 -> dataset/gestures/leftkick.bvh  : 
Number of Values Per Frame: 498
Frames: 25(25) / Frame Time : 0.0400
Gesture dataset/gestures/leftkick.bvh has 25 frames with 498 fields each
Joint 447/lhip_Zrotation is going to be used for gesture #7
Joint 448/lhip_Xrotation is going to be used for gesture #7
Joint 449/lhip_Yrotation is going to be used for gesture #7
Joint 450/lknee_Zrotation is going to be used for gesture #7
Joint 451/lknee_Xrotation is going to be used for gesture #7
Joint 452/lknee_Yrotation is going to be used for gesture #7
Success , loaded 25 frames
Loading Gesture 8 -> dataset/gestures/rightkick.bvh  : 
Number of Values Per Frame: 498
Frames: 26(26) / Frame Time : 0.0400
Gesture dataset/gestures/rightkick.bvh has 26 frames with 498 fields each
Joint 393/rhip_Zrotation is going to be used for gesture #8
Joint 394/rhip_Xrotation is going to be used for gesture #8
Joint 395/rhip_Yrotation is going to be used for gesture #8
Joint 396/rknee_Zrotation is going to be used for gesture #8
Joint 397/rknee_Xrotation is going to be used for gesture #8
Joint 398/rknee_Yrotation is going to be used for gesture #8
Success , loaded 26 frames
Loading Gesture 9 -> dataset/gestures/tpose.bvh  : 
Number of Values Per Frame: 498
Frames: 61(61) / Frame Time : 0.0400
Gesture dataset/gestures/tpose.bvh has 61 frames with 498 fields each
Joint 238/rshoulder_Xrotation is going to be used for gesture #9
Joint 239/rshoulder_Yrotation is going to be used for gesture #9
Joint 315/lshoulder_Zrotation is going to be used for gesture #9
Joint 316/lshoulder_Xrotation is going to be used for gesture #9
Joint 319/lelbow_Xrotation is going to be used for gesture #9
Joint 320/lelbow_Yrotation is going to be used for gesture #9
Success , loaded 61 frames
Loading Pose 0 -> dataset/poses/neutral.bvh  : Pose 0 -> dataset/poses/neutral.bvh  is corrupted
Failure
Loading Pose 1 -> dataset/poses/tpose.bvh  : Pose 1 -> dataset/poses/tpose.bvh  is corrupted
Failure
Loading Pose 2 -> dataset/poses/x.bvh  : Pose 2 -> dataset/poses/x.bvh  is corrupted
Failure
Loading Pose 3 -> dataset/poses/handsup.bvh  : Pose 3 -> dataset/poses/handsup.bvh  is corrupted
Failure
Loading Pose 4 -> dataset/poses/leftwave.bvh  : Pose 4 -> dataset/poses/leftwave.bvh  is corrupted
Failure
Loading Pose 5 -> dataset/poses/rightright.bvh  : Pose 5 -> dataset/poses/rightright.bvh  is corrupted
Failure
Loading Pose 6 -> dataset/poses/leftleft.bvh  : Pose 6 -> dataset/poses/leftleft.bvh  is corrupted
Failure
Loading Pose 7 -> dataset/poses/push.bvh  : Pose 7 -> dataset/poses/push.bvh  is corrupted
Failure
Loading Pose 8 -> dataset/poses/rightwave.bvh  : Pose 8 -> dataset/poses/rightwave.bvh  is corrupted
Failure
Failed to read recognized Poses
This is not fatal, but poses/gestures will be deactivated..
Initializing output filters : .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/categorize_upperbody_all.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/categorize_upperbody_all.pb
Tensor: input_all inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/categorize_upperbody_all.pb
Tensor: result_all/concat inputs: 3
 outputs: 1
2020-10-15 14:35:58.396721: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:35:58.396768: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_front.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_front.pb
Tensor: input_front inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_front.pb
Tensor: result_front/concat inputs: 43
 outputs: 1
2020-10-15 14:35:58.479954: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:35:58.479988: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_back.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_back.pb
Tensor: input_back inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_back.pb
Tensor: result_back/concat inputs: 43
 outputs: 1
2020-10-15 14:35:58.556299: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:35:58.556343: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_left.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_left.pb
Tensor: input_left inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_left.pb
Tensor: result_left/concat inputs: 43
 outputs: 1
2020-10-15 14:35:58.631395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:35:58.631439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_right.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_right.pb
Tensor: input_right inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_right.pb
Tensor: result_right/concat inputs: 43
 outputs: 1
2020-10-15 14:35:58.709670: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:35:58.709707: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
Caching networks after initialization to be ready for use..
2020-10-15 14:35:58.750881: W tensorflow/compiler/jit/mark_for_compilation_pass.cc:1412] (One-time warning): Not using XLA:CPU for cluster because envvar TF_XLA_FLAGS=--tf_xla_cpu_global_jit was not set.  If you want XLA:CPU, either set that envvar, or use experimental_jit_scope to enable XLA:CPU.  To confirm that XLA is active, pass --vmodule=xla_compilation_cache=1 (as a proper command-line flag, not via TF_XLA_FLAGS) or set the envvar XLA_FLAGS=--xla_hlo_profile.
Caching model 0 (dataset/combinedModel/mocapnet2/mode5/1.0/categorize_upperbody_all.pb) was successful
Caching model 1 (dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_front.pb) was successful
Caching model 2 (dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_back.pb) was successful
Caching model 3 (dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_left.pb) was successful
Caching model 4 (dataset/combinedModel/mocapnet2/mode5/1.0/upperbody_right.pb) was successful
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/categorize_lowerbody_all.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/categorize_lowerbody_all.pb
Tensor: input_all inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/categorize_lowerbody_all.pb
Tensor: result_all/concat inputs: 3
 outputs: 1
2020-10-15 14:36:03.779817: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:36:03.779861: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_front.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_front.pb
Tensor: input_front inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_front.pb
Tensor: result_front/concat inputs: 46
 outputs: 1
2020-10-15 14:36:03.857417: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:36:03.857466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_back.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_back.pb
Tensor: input_back inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_back.pb
Tensor: result_back/concat inputs: 46
 outputs: 1
2020-10-15 14:36:03.933404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:36:03.933455: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_left.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_left.pb
Tensor: input_left inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_left.pb
Tensor: result_left/concat inputs: 46
 outputs: 1
2020-10-15 14:36:03.994146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:36:03.994192: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
LoadGraph dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_right.pb using TensorFlow Version: 1.14.0
 Input Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_right.pb
Tensor: input_right inputs: 0
 outputs: 1
 Output Tensor for dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_right.pb
Tensor: result_right/concat inputs: 46
 outputs: 1
2020-10-15 14:36:04.061722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-10-15 14:36:04.061785: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187]      
Caching networks after initialization to be ready for use..
Caching model 0 (dataset/combinedModel/mocapnet2/mode5/1.0/categorize_lowerbody_all.pb) was successful
Caching model 1 (dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_front.pb) was successful
Caching model 2 (dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_back.pb) was successful
Caching model 3 (dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_left.pb) was successful
Caching model 4 (dataset/combinedModel/mocapnet2/mode5/1.0/lowerbody_right.pb) was successful
Unable to init server: Could not connect: Connection refused

(3D Points Output:2846): Gtk-WARNING **: 14:36:07.879: cannot open display:
AmmarkoV commented 4 years ago

Hello, You are right, the new version no longer had a "headless mode" during the transition from MocapNET 1 I am adding it back in..!

AmmarkoV commented 4 years ago

Please git pull / recompile and test again, it should work now..!

PiotrMi commented 4 years ago

Thanks a lot, it works!