search

sgoldenlab / simba

SimBA (Simple Behavioral Analysis), a pipeline and GUI for developing supervised behavioral classifiers
https://simba-uw-tf-dev.readthedocs.io/
GNU General Public License v3.0
286 stars 139 forks source link

Duplication of animal from SLEAP .slp or .csv file #155

Open catubc opened 2 years ago

catubc commented 2 years ago

Describe the bug Hello I am trying to label behavior for an mp4 video and I don't see the video panel showing up as in the simba instructions. Is this normal? There is an attribute error in the dataframe, not clear where the error could be coming from, perhaps tkinter?

Thanks so much

Ubuntu 18.04, conda tkinter version: tk 8.6.10 hbc83047_0 anaconda

simba1

[Edit: ] I think I might be missing the .csv generation step.

catubc commented 2 years ago

Ok, so it seems that I had to manually move the .csv files to get past this step. I had assumed simba would extract the .csv data from the .slp file and populate.

But I'm still getting an error due to the naming of the animals. 

(simba3) cat@cat-Precision-T3610:~$ simba
Exception in Tkinter callback
Traceback (most recent call last):
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/tkinter/__init__.py", line 1705, in __call__
    return self.func(*args)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/SimBA.py", line 3924, in <lambda>
    button_labelaggression = Button(label_labelaggression, text='Select video (create new video annotation)',command= lambda:choose_folder(self.projectconfigini))
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/labelling_aggression.py", line 364, in choose_folder
    MainInterface()
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/labelling_aggression.py", line 178, in __init__
    load_frame(0, self.window, self.fbox, )
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/labelling_aggression.py", line 441, in load_frame
    currAnimal = currDf.loc[currDf.index[current_frame_number], [currXheader, currYheader]]
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/indexing.py", line 1418, in __getitem__
    return self._getitem_tuple(key)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/indexing.py", line 805, in _getitem_tuple
    return self._getitem_lowerdim(tup)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/indexing.py", line 961, in _getitem_lowerdim
    return getattr(section, self.name)[new_key]
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/indexing.py", line 1424, in __getitem__
    return self._getitem_axis(maybe_callable, axis=axis)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/indexing.py", line 1839, in _getitem_axis
    return self._getitem_iterable(key, axis=axis)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/indexing.py", line 1133, in _getitem_iterable
    keyarr, indexer = self._get_listlike_indexer(key, axis, raise_missing=False)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/indexing.py", line 1092, in _get_listlike_indexer
    keyarr, indexer, o._get_axis_number(axis), raise_missing=raise_missing
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/indexing.py", line 1177, in _validate_read_indexer
    key=key, axis=self.obj._get_axis_name(axis)
KeyError: "None of [Index(['female_nose_1_2_x', 'female_nose_1_2_y'], dtype='object')] are in the [index]"

And here's the top of the .csv:


scorer,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi
bodypart,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi
coords,female_nose_x,female_nose_y,female_nose_p,female_spine1_x,female_spine1_y,female_spine1_p,female_spine2_x,female_spine2_y,female_spine2_p,female_spine3_x,female_spine3_y,female_spine3_p,female_spine4_x,female_spine4_y,female_spine4_p,female_spine5_x,female_spine5_y,female_spine5_p,female_nose_x,female_nose_y,female_nose_p,female_spine1_x,female_spine1_y,female_spine1_p,female_spine2_x,female_spine2_y,female_spine2_p,female_spine3_x,female_spine3_y,female_spine3_p,female_spine4_x,female_spine4_y,female_spine4_p,female_spine5_x,female_spine5_y,female_spine5_p,male_nose_x,male_nose_y,male_nose_p,male_spine1_x,male_spine1_y,male_spine1_p,male_spine2_x,male_spine2_y,male_spine2_p,male_spine3_x,male_spine3_y,male_spine3_p,male_spine4_x,male_spine4_y,male_spine4_p,male_spine5_x,male_spine5_y,male_spine5_p,pup1_nose_x,pup1_nose_y,pup1_nose_p,pup1_spine1_x,pup1_spine1_y,pup1_spine1_p,pup1_spine2_x,pup1_spine2_y,pup1_spine2_p,pup1_spine3_x,pup1_spine3_y,pup1_spine3_p,pup1_spine4_x,pup1_spine4_y,pup1_spine4_p,pup1_spine5_x,pup1_spine5_y,pup1_spine5_p,pup2_nose_x,pup2_nose_y,pup2_nose_p,pup2_spine1_x,pup2_spine1_y,pup2_spine1_p,pup2_spine2_x,pup2_spine2_y,pup2_spine2_p,pup2_spine3_x,pup2_spine3_y,pup2_spine3_p,pup2_spine4_x,pup2_spine4_y,pup2_spine4_p,pup2_spine5_x,pup2_spine5_y,pup2_spine5_p,pup3_nose_x,pup3_nose_y,pup3_nose_p,pup3_spine1_x,pup3_spine1_y,pup3_spine1_p,pup3_spine2_x,pup3_spine2_y,pup3_spine2_p,pup3_spine3_x,pup3_spine3_y,pup3_spine3_p,pup3_spine4_x,pup3_spine4_y,pup3_spine4_p,pup3_spine5_x,pup3_spine5_y,pup3_spine5_p,pup4_nose_x,pup4_nose_y,pup4_nose_p,pup4_spine1_x,pup4_spine1_y,pup4_spine1_p,pup4_spine2_x,pup4_spine2_y,pup4_spine2_p,pup4_spine3_x,pup4_spine3_y,pup4_spine3_p,pup4_spine4_x,pup4_spine4_y,pup4_spine4_p,pup4_spine5_x,pup4_spine5_y,pup4_spine5_p
0,496.2355041503906,220.567626953125,0.9527365565299988,500.4596252441406,263.92752075195307,0.8128677010536194,503.2895812988281,292.5050964355469,0.711251437664032,500.05694580078125,320.3348693847656,0.6614666581153871,503.6937255859375,343.82562255859375,0.3003198206424713,0.0,0.0,0.0,496.2355041503906,220.567626953125,0.9527365565299988,500.4596252441406,263.92752075195307,0.8128677010536194,503.2895812988281,292.5050964355469,0.711251437664032,500.05694580078125,320.3348693847656,0.6614666581153871,503.6937255859375,343.82562255859375,0.3003198206424713,0.0,0.0,0.0,0.0,0.0,0.0,535.5052490234375,379.9781188964844,0.2975809574127197,508.6451110839844,383.20098876953125,0.5648311972618103,483.367919921875,384.58819580078125,0.6478815674781799,451.7007446289063,391.420654296875,0.7451946139335632,423.4447937011719,399.6026611328125,0.9182761311531068,648.0948486328125,515.2940063476561,0.2229043692350388,636.2654418945312,516.0468139648439,0.8575764894485474,612.0125732421875,508.645751953125,0.7609681487083435,591.1453857421875,500.4262390136719,0.832747220993042,571.529541015625,495.3873901367188,0.8492857813835144,548.5122680664061,487.8362121582031,0.8720636367797852,600.7646484375,575.720458984375,0.5423446297645569,583.8673706054688,572.3936157226562,0.7516449689865112,563.8768920898438,567.9528198242188,0.7206470966339111,543.586669921875,556.2380981445311,0.7213824987411499,527.6947631835939,543.9876098632811,0.7564922571182251,515.7238159179689,524.171630859375,0.7290070056915283,384.0461730957031,535.8851928710939,0.8675850033760071,396.2161865234375,559.5531005859375,0.8782817721366882,412.5365295410156,571.8739013671875,0.8699088096618652,436.2445373535156,579.6212158203125,0.7766255736351013,456.49560546875,579.3140869140625,0.883823573589325,475.4640197753906,575.2548828125,0.9269698858261108,336.589599609375,543.6217651367189,0.8530907034873962,307.4103698730469,560.0713500976561,0.7831662893295288,288.1627502441406,564.1406860351562,0.8259077072143555,268.6378173828125,567.1624755859375,0.8390766978263855,251.97784423828125,563.4893188476562,0.9189422726631165,235.6845550537109,556.4923095703125,0.9046114683151244
1,496.2879638671875,220.63107299804688,0.9547415375709534,500.44415283203125,264.14016723632807,0.8200687766075134,500.6158142089844,295.5201721191406,0.7471846938133241,499.6556701660156,320.661865234375,0.6593335270881653,503.5816650390625,344.24212646484375,0.28254279494285583,0.0,0.0,0.0,496.2879638671875,220.63107299804688,0.9547415375709534,500.44415283203125,264.14016723632807,0.8200687766075134,500.6158142089844,295.5201721191406,0.7471846938133241,499.6556701660156,320.661865234375,0.6593335270881653,503.5816650390625,344.24212646484375,0.28254279494285583,0.0,0.0,0.0,0.0,0.0,0.0,535.52880859375,379.43389892578125,0.3010869026184082,508.5622863769531,380.3068542480469,0.5687392354011536,483.4601440429688,384.4634704589844,0.6695404052734375,451.8765563964844,391.38427734375,0.7627116441726685,423.4925231933594,399.610595703125,0.9281686544418336,0.0,0.0,0.0,636.1993408203125,516.1194458007811,0.8542495369911194,612.2576904296875,508.6696472167969,0.7529775500297546,591.4818725585938,503.501708984375,0.845646858215332,571.4248046875,495.66845703125,0.8548214435577393,548.2125244140625,488.059326171875,0.8840513825416565,596.8784790039062,579.6757202148438,0.4539488852024078,580.1005249023438,575.897705078125,0.8403472304344177,560.4075317382811,567.7429809570312,0.7307121157646179,543.7866821289061,555.66943359375,0.788873016834259,527.8856201171875,543.5237426757811,0.8062229752540588,515.6806030273439,523.9407958984375,0.7190098762512207,380.3003845214844,536.2025146484375,0.8638001084327698,395.5709228515625,559.7769165039061,0.8765522241592407,412.270263671875,571.87744140625,0.8725616931915283,436.1148071289063,576.8961791992188,0.7829010486602783,456.60833740234375,576.468994140625,0.9018959403038024,475.4982604980469,575.1974487304688,0.9149670600891112,336.52490234375,543.4237670898439,0.8464635014533997,304.5652160644531,559.7457885742189,0.7898238301277161,288.0775146484375,563.6826171875,0.8300068378448486,268.6436767578125,564.4812622070312,0.8552283048629761,251.9909210205078,563.39990234375,0.9223942160606384,235.6182403564453,556.50244140625,0.914698362350464
2,496.2433776855469,220.63575744628903,0.9665535688400269,499.9832763671875,264.24392700195307,0.8199657201766968,500.14794921875,292.3388671875,0.7738865613937378,499.8458557128906,319.84124755859375,0.6679050326347351,500.36553955078125,340.48931884765625,0.25780370831489563,0.0,0.0,0.0,496.2433776855469,220.63575744628903,0.9665535688400269,499.9832763671875,264.24392700195307,0.8199657201766968,500.14794921875,292.3388671875,0.7738865613937378,499.8458557128906,319.84124755859375,0.6679050326347351,500.36553955078125,340.48931884765625,0.25780370831489563,0.0,0.0,0.0,0.0,0.0,0.0,535.7659301757811,376.2238159179688,0.3028284311294556,508.7102966308594,379.6003112792969,0.6317318081855774,483.5924377441406,387.3358154296875,0.6752269864082336,452.025146484375,391.7570495605469,0.7950249910354614,423.46099853515625,399.7508239746094,0.9333615303039552,0.0,0.0,0.0,635.730712890625,516.7711181640625,0.8310267329216003,612.0079345703125,511.363525390625,0.762147068977356,591.093017578125,500.4256896972656,0.8568326830863953,571.1381225585938,492.3208312988281,0.8802744746208191,547.9884033203125,487.4876708984375,0.909387707710266,595.5662841796875,584.20361328125,0.4263121783733368,579.7064819335938,575.8665161132812,0.9165925383567809,560.4127197265625,564.1045532226562,0.7897042036056519,544.43017578125,552.35595703125,0.8962704539299011,531.8712158203125,540.1428833007811,0.8099266290664673,516.0972900390625,520.5545654296875,0.6749165058135986,383.7297668457031,536.6251220703125,0.885046660900116,399.0272216796875,563.7530517578125,0.8159060478210449,416.0726013183594,575.8941040039062,0.8500763177871704,439.9586791992188,580.58154296875,0.7841462492942809,460.42950439453125,579.9993286132812,0.9021166563034058,479.51409912109375,576.2071533203125,0.9634618163108826,336.4267272949219,543.4904174804689,0.8616150617599487,304.5447998046875,559.779296875,0.8029708266258241,288.0079345703125,563.6052856445312,0.8483252525329591,268.59991455078125,564.447509765625,0.8895316123962402,251.9477996826172,563.3316650390625,0.9515439867973328,235.4656982421875,556.5100708007811,0.9436629414558412
3,496.3336486816406,220.60630798339844,0.9788330197334291,499.9425659179688,264.322021484375,0.804137647151947,500.09765625,292.3538513183594,0.7415158748626709,499.5601196289063,319.8631286621094,0.5986077189445496,496.1994934082031,339.91497802734375,0.2303672730922699,0.0,0.0,0.0,496.3336486816406,220.60630798339844,0.9788330197334291,499.9425659179688,264.322021484375,0.804137647151947,500.09765625,292.3538513183594,0.7415158748626709,499.5601196289063,319.8631286621094,0.5986077189445496,496.1994934082031,339.91497802734375,0.2303672730922699,0.0,0.0,0.0,0.0,0.0,0.0,535.851318359375,376.1219177246094,0.2715684771537781,511.40521240234375,379.5197143554688,0.6323232650756836,483.6984558105469,387.4959411621094,0.6817506551742554,452.0848388671875,391.9915466308594,0.7969747185707092,423.5086975097656,399.751953125,0.931324303150177,0.0,0.0,0.0,635.8026733398438,519.3413696289061,0.8352226018905641,612.049072265625,511.3312683105469,0.7598195672035217,591.0923461914062,500.4587707519531,0.8572355508804321,571.091064453125,492.3470458984375,0.8748998045921326,547.8760375976561,487.6129455566406,0.9061638712882996,595.7015991210938,584.3153076171875,0.4555864632129669,579.4247436523438,576.3525390625,0.8828028440475464,560.09912109375,564.3056640625,0.7970129251480103,544.3431396484375,552.4615478515625,0.9156122803688048,531.9349975585939,540.1621704101561,0.8178607225418091,516.20703125,520.53466796875,0.6942353248596191,387.8775024414063,532.72314453125,0.9184426665306092,400.0733947753906,560.5511474609375,0.8534789681434631,419.3782043457031,575.6778564453125,0.8712479472160339,440.1101379394531,580.6194458007812,0.7905017137527466,460.2353820800781,580.6527709960938,0.9004195332527161,476.6386413574219,579.4889526367188,0.993718922138214,336.3165283203125,543.4000244140625,0.8707237243652344,307.3284606933594,559.9840698242189,0.8165134787559509,288.01300048828125,563.919921875,0.8597572445869446,268.43829345703125,564.7252197265625,0.8994816541671753,251.8329925537109,563.4426879882812,0.9700333476066588,235.3411865234375,556.5420532226561,0.9455788135528564
4,496.3221130371094,220.76739501953125,0.9742648005485536,500.30377197265625,267.73977661132807,0.8045008778572083,500.3703002929688,296.0572509765625,0.7457910180091858,496.38751220703125,324.16619873046875,0.5705496072769165,0.0,0.0,0.0,0.0,0.0,0.0,496.3221130371094,220.76739501953125,0.9742648005485536,500.30377197265625,267.73977661132807,0.8045008778572083,500.3703002929688,296.0572509765625,0.7457910180091858,496.38751220703125,324.16619873046875,0.5705496072769165,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,535.6304321289061,376.6114196777344,0.28071537613868713,511.6216735839844,379.8400268554688,0.6062015891075134,483.7198181152344,387.395263671875,0.6623584032058716,452.0174255371094,391.9966125488281,0.7904066443443298,423.2991943359375,399.8789978027344,0.9169630408287048,0.0,0.0,0.0,636.1013793945312,519.4646606445311,0.8235352039337158,612.2467651367188,511.4793701171875,0.7594605088233948,591.4236450195312,503.55023193359375,0.8789750933647156,571.32177734375,495.489990234375,0.8497058153152466,548.1092529296875,487.7808532714844,0.9143038988113404,595.8994750976562,584.0189208984375,0.4693641066551209,579.4336547851562,576.488525390625,0.89593905210495,560.1011352539061,564.6260375976562,0.7874167561531067,544.1777954101561,552.5606079101561,0.9036816358566284,531.7984008789061,540.2230834960939,0.8270125985145569,516.0720825195311,520.497802734375,0.7120351195335388,391.9834289550781,523.5908813476561,0.9743152260780334,399.96185302734375,555.2852172851561,0.8106785416603088,415.4165649414063,571.713623046875,0.8993117213249207,436.4542236328125,580.239990234375,0.8227529525756836,456.0745544433594,583.6392211914062,0.8926184773445129,472.4842529296875,580.263671875,0.997106432914734,336.2913513183594,544.0748291015625,0.8766992688179016,304.46380615234375,563.096923828125,0.8131293654441833,287.95965576171875,564.5267333984375,0.8448421359062195,268.37100219726557,567.411865234375,0.9186647534370422,251.7641906738281,563.519775390625,0.9665551781654358,235.3104705810547,556.5091552734375,0.9400166273117064
5,49
sronilsson commented 2 years ago

Hi @catubc! The labelling interface looks in project_folder/csv/features_extracted for a CSV (or parquet, depending on your settings) and a matching video file. It looks like there aren't any files in the folder, I can see that the feature extraction step failed: Extracting features from 0 files. This suggests that the step before this, the outlier correction, might not have been completed - I recommend you click on the red skip outlier correction button the the [Outlier correction] tab. This should give you files to generate features for. The printouts in your screenshot suggests the video is fine.

Just a note, I can see the readthedocs documentation. I have not written that and do not maintain and haven't read it, I don't think anyone in the lab is developing or maintaining those docs. I recommend the github mds' for the docs https://github.com/sgoldenlab/simba#scenario-tutorials

sronilsson commented 2 years ago

@catubc - do all of your animals have the same body-parts tracked? Did you manually move them from input_csv to features_extracted folder?

catubc commented 2 years ago

Ok, I started over from scratch with a new project. This time I didnot move any .csv files anywhere. And yes, all the animals have 6 points along the spine labeled. However, there is occlusion at times and SLEAP does not return labels for some cases. I assume this would be ok, or at least if I ran the interpolation step.

I can now get to outlier correction, not sure. It's still a similar crash. 


Warning: The video name could not be found in the .SLP meta-data table
SimBA therefore gives the imported CSV the same name as the SLP file.
To be sure that SimBAs slp import function works, make sure the .SLP file and the associated video file has the same file name - e.g., "Video1.mp4" and "Video1.slp" before importing the videos and SLP files to SimBA.
Re-organizing pose data-frame based on user-assigned identities: 2020_08_01_11_27_15_857870_compressed_corrected.mp4....
Interpolating missing values (Method: Body-parts: Nearest) ...
Please select the project_config.ini file
/media/cat/256GB/dan/simba/cohorts/gerbils2/project_folder/project_config.ini
Table updated.
/media/cat/256GB/dan/simba/cohorts/gerbils2/project_folder/logs generated.
/media/cat/256GB/dan/simba/cohorts/gerbils2/project_folder/logs generated.
Outlier correction settings updated in project_config.ini
Number of Frames: 28802
/media/cat/256GB/dan/simba/cohorts/gerbils2/project_folder/csv/features_extracted/2020_08_01_11_27_15_857870_compressed_corrected.csv @@@@@@@@@@@@@
The CSV file could not be located at the following path: /media/cat/256GB/dan/simba/cohorts/gerbils2/project_folder/csv/features_extracted/2020_08_01_11_27_15_857870_compressed_corrected.csv . It may be that you missed a step in the analysis. Please generate the file before proceeding.
None
Applying settings for multi-animal tracking...

And here's the command line:

(simba3) cat@cat-Precision-T3610:~$ simba
Exception in Tkinter callback
Traceback (most recent call last):
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/tkinter/__init__.py", line 1705, in __call__
    return self.func(*args)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/SimBA.py", line 3924, in <lambda>
    button_labelaggression = Button(label_labelaggression, text='Select video (create new video annotation)',command= lambda:choose_folder(self.projectconfigini))
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/labelling_aggression.py", line 364, in choose_folder
    MainInterface()
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/labelling_aggression.py", line 178, in __init__
    load_frame(0, self.window, self.fbox, )
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/labelling_aggression.py", line 441, in load_frame
    currAnimal = currDf.loc[currDf.index[current_frame_number], [currXheader, currYheader]]
AttributeError: 'NoneType' object has no attribute 'loc'
catubc commented 2 years ago

I went back and ran feature-extraction also.

(simba3) cat@cat-Precision-T3610:~$ simba
Exception in Tkinter callback
Traceback (most recent call last):
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/tkinter/__init__.py", line 1705, in __call__
    return self.func(*args)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/SimBA.py", line 3924, in <lambda>
    button_labelaggression = Button(label_labelaggression, text='Select video (create new video annotation)',command= lambda:choose_folder(self.projectconfigini))
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/labelling_aggression.py", line 364, in choose_folder
    MainInterface()
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/labelling_aggression.py", line 178, in __init__
    load_frame(0, self.window, self.fbox, )
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/labelling_aggression.py", line 441, in load_frame
    currAnimal = currDf.loc[currDf.index[current_frame_number], [currXheader, currYheader]]
AttributeError: 'NoneType' object has no attribute 'loc'

feat

catubc commented 2 years ago

I'm also getting this error, I think during outlierCorrection (or even if I try to skip it).


Exception in Tkinter callback
Traceback (most recent call last):
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/tkinter/__init__.py", line 1705, in __call__
    return self.func(*args)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/SimBA.py", line 3895, in <lambda>
    button_skipOC = Button(label_outliercorrection,text='Skip outlier correction (CAUTION)',fg='red', command=lambda:skip_outlier_c(self.projectconfigini))
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/outlier_scripts/skip_outlierCorrection.py", line 61, in skip_outlier_c
    csv_df.columns = newHeaders
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/generic.py", line 5192, in __setattr__
    return object.__setattr__(self, name, value)
  File "pandas/_libs/properties.pyx", line 67, in pandas._libs.properties.AxisProperty.__set__
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/generic.py", line 690, in _set_axis
    self._data.set_axis(axis, labels)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/internals/managers.py", line 183, in set_axis
    "values have {new} elements".format(old=old_len, new=new_len)
ValueError: Length mismatch: Expected axis has 126 elements, new values have 108 elements

[Edit:] Perhaps I'm not getting past the outlier correction. Maybe due to missing values in the data where SLEAP did not find any features?

catubc commented 2 years ago

Actually, I think the interpolation step is failing well before I get to these steps.

Is there some other preprocessing step that I have to do on the .slp file? Perhaps Talmo has code to fix the .slp files before loading into simba?

inteprolation .

sronilsson commented 2 years ago

Hi @catubc - I think most or all errors, could originate from the body part configuration that you specified SimBA to use in your project - we have 6 animals each with 6 body-parts each having 3 values (x,y,p) (663=108). SimBA, however, assumes that there should be 126 columns, which means that there is either an extra body-part for each animal, or an extra animal.

When you click skip outlier correction, SimBA takes the imported pose-estimation files, and without performing any outlier correction, just modifies the headings to make it compatible with the rest of the functions down-stream, and make similar regardless of the pose-estimation tool it comes from (sleap, dlc, animal tracker etc..) It is here SimBA tries to fit 126 headers to a 108-field file and this is the reason you see the error. When you specified the body-parts, is it possible you added an animal too many or a body-part too many?

When you define the body-parts, the data is saved in a CSV at project_folder/logs/measures/body_parts_configuration/body_configurations.csv (or something very similar, I can't remember exact). You could open this file in your project and check for any odd ones that should not be there?

catubc commented 2 years ago

Thanks for that, so there's clearly something weird going on. Perhaps I used 0-based indices in simba somewhere?

In any case, I'm certain there aren't additional animals or features, here's the sleap file and the nodes and track info, there are only 6 animals (female, male, pup1-4) and 6 features (nose, spine1-5).

(sleap) cat@cat-Precision-T7610:~/data/simba$ python
Python 3.6.13 |Anaconda, Inc.| (default, Jun  4 2021, 14:25:59) 
[GCC 7.5.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import sleap
s2021-12-20 12:27:22.061021: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
l>>> sleap.load_file(2020_08_01_11_27_15_857870_compressed_corrected.mp4.predictions.slp')
Labels(labeled_frames=28802, videos=1, skeletons=1, tracks=6)
>>> labels = sleap.load_file('2020_08_01_11_27_15_857870_compressed_corrected.mp4.predictions.slp')
>>> labels.nodes
[Node(name='spine5', weight=1.0), Node(name='spine2', weight=1.0), Node(name='spine4', weight=1.0), Node(name='nose', weight=1.0), Node(name='spine3', weight=1.0), Node(name='spine1', weight=1.0)]
>>> labels.tracks
[Track(spawned_on=0, name='female'), Track(spawned_on=0, name='male'), Track(spawned_on=0, name='pup1'), Track(spawned_on=0, name='pup2'), Track(spawned_on=0, name='pup3'), Track(spawned_on=0, name='pup4')]
>>>
catubc commented 2 years ago

Here's the make simba config step make_simba_config

catubc commented 2 years ago

And here's the import sleap step import_sleap

catubc commented 2 years ago

And here's the confirmation that simba only sees 6 animals and 6 features animals

catubc commented 2 years ago

The error occurs right after I press "c" at this step. Screenshot from 2021-12-20 18-45-33

catubc commented 2 years ago

And this error reoccurs at outlier detection again. Screenshot from 2021-12-20 18-51-21

Screenshot from 2021-12-20 18-51-31

sronilsson commented 2 years ago

Yeah your tracking data looks solid. It also looks good after you have imported into SimBA, as in your screenshot from the project_folder/csv/input_csv example a while back. It is the next step, after import, when you click skip outlier correction where SimBA tries to apply the the headers that you specify the user_defined configuration on your files we get the error and I think I know why.. I'm not sure you are going to like me for this solution.. :) but bear in mind it is designed to accommodate people who have an unequal and different body-parts tracked on different animals. In the # bodyparts entry box you set 36, not 6. And you create a table looking like this (excuse me, I dont have SimBA installed on where I am and had to draw it in a spreadsheet: image

If this is too much of a pain, we could modify the project_folder/logs/measures/body_parts_configuration/body_configurations.csv files directly.

catubc commented 2 years ago

Well, I did the first option you suggested, but I get the exact same error Screenshot from 2021-12-20 19-06-03 .

catubc commented 2 years ago

Screenshot from 2021-12-20 19-07-49

catubc commented 2 years ago

Screenshot from 2021-12-20 19-12-58

catubc commented 2 years ago

Re: option #2, this file doesn't exist

...project_folder/logs/measures/body_parts_configuration/body_configurations.csv files directly.

In the logs subdirectories there's only 1 file project_bp_names.csv:


female_nose_1_2
female_spine1_1_2
female_spine2_1_2
female_spine3_1_2
female_spine4_1_2
female_spine5_1_2
male_nose_2
male_spine1_2
male_spine2_2
male_spine3_2
male_spine4_2
male_spine5_2
pup1_nose_3
pup1_spine1_3
pup1_spine2_3
pup1_spine3_3
pup1_spine4_3
pup1_spine5_3
pup2_nose_4
pup2_spine1_4
pup2_spine2_4
pup2_spine3_4
pup2_spine4_4
pup2_spine5_4
pup3_nose_5
pup3_spine1_5
pup3_spine2_5
pup3_spine3_5
pup3_spine4_5
pup3_spine5_5
pup4_nose_6
pup4_spine1_6
pup4_spine2_6
pup4_spine3_6
pup4_spine4_6
pup4_spine5_6
catubc commented 2 years ago

So one weird thing appears to be that the sleap .csv files inthe root directory and in the input_CSV have different number of headings

Here's the one from the project_folder/csv/input_csv:

scorer,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi
bodypart,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi,SLEAP_multi
coords,female_nose_x,female_nose_y,female_nose_p,female_spine1_x,female_spine1_y,female_spine1_p,female_spine2_x,female_spine2_y,female_spine2_p,female_spine3_x,female_spine3_y,female_spine3_p,female_spine4_x,female_spine4_y,female_spine4_p,female_spine5_x,female_spine5_y,female_spine5_p,female_nose_x,female_nose_y,female_nose_p,female_spine1_x,female_spine1_y,female_spine1_p,female_spine2_x,female_spine2_y,female_spine2_p,female_spine3_x,female_spine3_y,female_spine3_p,female_spine4_x,female_spine4_y,female_spine4_p,female_spine5_x,female_spine5_y,female_spine5_p,male_nose_x,male_nose_y,male_nose_p,male_spine1_x,male_spine1_y,male_spine1_p,male_spine2_x,male_spine2_y,male_spine2_p,male_spine3_x,male_spine3_y,male_spine3_p,male_spine4_x,male_spine4_y,male_spine4_p,male_spine5_x,male_spine5_y,male_spine5_p,pup1_nose_x,pup1_nose_y,pup1_nose_p,pup1_spine1_x,pup1_spine1_y,pup1_spine1_p,pup1_spine2_x,pup1_spine2_y,pup1_spine2_p,pup1_spine3_x,pup1_spine3_y,pup1_spine3_p,pup1_spine4_x,pup1_spine4_y,pup1_spine4_p,pup1_spine5_x,pup1_spine5_y,pup1_spine5_p,pup2_nose_x,pup2_nose_y,pup2_nose_p,pup2_spine1_x,pup2_spine1_y,pup2_spine1_p,pup2_spine2_x,pup2_spine2_y,pup2_spine2_p,pup2_spine3_x,pup2_spine3_y,pup2_spine3_p,pup2_spine4_x,pup2_spine4_y,pup2_spine4_p,pup2_spine5_x,pup2_spine5_y,pup2_spine5_p,pup3_nose_x,pup3_nose_y,pup3_nose_p,pup3_spine1_x,pup3_spine1_y,pup3_spine1_p,pup3_spine2_x,pup3_spine2_y,pup3_spine2_p,pup3_spine3_x,pup3_spine3_y,pup3_spine3_p,pup3_spine4_x,pup3_spine4_y,pup3_spine4_p,pup3_spine5_x,pup3_spine5_y,pup3_spine5_p,pup4_nose_x,pup4_nose_y,pup4_nose_p,pup4_spine1_x,pup4_spine1_y,pup4_spine1_p,pup4_spine2_x,pup4_spine2_y,pup4_spine2_p,pup4_spine3_x,pup4_spine3_y,pup4_spine3_p,pup4_spine4_x,pup4_spine4_y,pup4_spine4_p,pup4_spine5_x,pup4_spine5_y,pup4_spine5_p
0,496.2355041503906,220.567626953125,0.9527365565299988,500.4596252441406,263.92752075195307,0.8128677010536194,503.2895812988281,292.5050964355469,0.711251437664032,500.05694580078125,320.3348693847656,0.6614666581153871,503.6937255859375,343.82562255859375,0.3003198206424713,0.0,0.0,0.0,496.2355041503906,220.567626953125,0.9527365565299988,500.4596252441406,263.92752075195307,0.8128677010536194,503.2895812988281,292.5050964355469,0.711251437664032,500.05694580078125,320.3348693847656,0.6614666581153871,503.6937255859375,343.82562255859375,0.3003198206424713,0.0,0.0,0.0,0.0,0.0,0.0,535.5052490234375,379.9781188964844,0.2975809574127197,508.6451110839844,383.20098876953125,0.5648311972618103,483.367919921875,384.58819580078125,0.6478815674781799,451.7007446289063,391.420654296875,0.7451946139335632,423.4447937011719,399.6026611328125,0.9182761311531068,648.0948486328125,515.2940063476561,0.2229043692350388,636.2654418945312,516.0468139648439,0.8575764894485474,612.0125732421875,508.645751953125,0.7609681487083435,591.1453857421875,500.4262390136719,0.832747220993042,571.529541015625,495.3873901367188,0.8492857813835144,548.5122680664061,487.8362121582031,0.8720636367797852,600.7646484375,575.720458984375,0.5423446297645569,583.8673706054688,572.3936157226562,0.7516449689865112,563.8768920898438,567.9528198242188,0.7206470966339111,543.586669921875,556.2380981445311,0.7213824987411499,527.6947631835939,543.9876098632811,0.7564922571182251,515.7238159179689,524.171630859375,0.7290070056915283,384.0461730957031,535.8851928710939,0.8675850033760071,396.2161865234375,559.5531005859375,0.8782817721366882,412.5365295410156,571.8739013671875,0.8699088096618652,436.2445373535156,579.6212158203125,0.7766255736351013,456.49560546875,579.3140869140625,0.883823573589325,475.4640197753906,575.2548828125,0.9269698858261108,336.589599609375,543.6217651367189,0.8530907034873962,307.4103698730469,560.0713500976561,0.7831662893295288,288.1627502441406,564.1406860351562,0.8259077072143555,268.6378173828125,567.1624755859375,0.8390766978263855,251.97784423828125,563.4893188476562,0.9189422726631165,235.6845550537109,556.4923095703125,0.9046114683151244
1,496.2879638671875,220.63107299804688,0.9547415375709534,500.44415283203125,264.14016723632807,0.8200687766075134,500.6158142089844,295.5201721191406,0.7471846938133241,499.6556701660156,320.661865234375,0.6593335270881653,503.5816650390625,344.24212646484375,0.28254279494285583,0.0,0.0,0.0,496.2879638671875,220.63107299804688,0.9547415375709534,500.44415283203125,264.14016723632807,0.8200687766075134,500.6158142089844,295.5201721191406,0.7471846938133241,499.6556701660156,320.661865234375,0.6593335270881653,503.5816650390625,344.24212646484375,0.28254279494285583,0.0,0.0,0.0,0.0,0.0,0.0,535.52880859375,379.43389892578125,0.3010869026184082,508.5622863769531,380.3068542480469,0.5687392354011536,483.4601440429688,384.4634704589844,0.6695404052734375,451.8765563964844,391.38427734375,0.7627116441726685,423.4925231933594,399.610595703125,0.9281686544418336,0.0,0.0,0.0,636.1993408203125,516.1194458007811,0.8542495369911194,612.2576904296875,508.6696472167969,0.7529775500297546,591.4818725585938,503.501708984375,0.845646858215332,571.4248046875,495.66845703125,0.8548214435577393,548.2125244140625,488.059326171875,0.8840513825416565,596.8784790039062,579.6757202148438,0.4539488852024078,580.1005249023438,575.897705078125,0.8403472304344177,560.4075317382811,567.7429809570312,0.7307121157646179,543.7866821289061,555.66943359375,0.788873016834259,527.8856201171875,543.5237426757811,0.8062229752540588,515.6806030273439,523.9407958984375,0.7190098762512207,380.3003845214844,536.2025146484375,0.8638001084327698,395.5709228515625,559.7769165039061,0.8765522241592407,412.270263671875,571.87744140625,0.8725616931915283,436.1148071289063,576.8961791992188,0.7829010486602783,456.60833740234375,576.468994140625,0.9018959403038024,475.4982604980469,575.1974487304688,0.9149670600891112,336.52490234375,543.4237670898439,0.8464635014533997,304.5652160644531,559.7457885742189,0.7898238301277161,288.0775146484375,563.6826171875,0.8300068378448486,268.6436767578125,564.4812622070312,0.8552283048629761,251.9909210205078,563.39990234375,0.9223942160606384,235.6182403564453,556.50244140625,0.914698362350464
2,496.2433776855469,220.63575744628903,0.9665535688400269,499.9832763671875,264.24392700195307,0.8199657201766968,500.14794921875,292.3388671875,0.7738865613937378,499.8458557128906,319.84124755859375,0.6679050326347351,500.36553955078125,340.48931884765625,0.25780370831489563,0.0,0.0,0.0,496.2433776855469,220.63575744628903,0.9665535688400269,499.9832763671875,264.24392700195307,0.8199657201766968,500.14794921875,292.3388671875,0.7738865613937378,499.8458557128906,319.84124755859375,0.6679050326347351,500.36553955078125,340.48931884765625,0.25780370831489563,0.0,0.0,0.0,0.0,0.0,0.0,535.7659301757811,376.2238159179688,0.3028284311294556,508.7102966308594,379.6003112792969,0.6317318081855774,483.5924377441406,387.3358154296875,0.6752269864082336,452.025146484375,391.7570495605469,0.7950249910354614,423.46099853515625,399.7508239746094,0.9333615303039552,0.0,0.0,0.0,635.730712890625,516.7711181640625,0.8310267329216003,612.0079345703125,511.363525390625,0.762147068977356,591.093017578125,500.4256896972656,0.8568326830863953,571.1381225585938,492.3208312988281,0.8802744746208191,547.9884033203125,487.4876708984375,0.909387707710266,595.5662841796875,584.20361328125,0.4263121783733368,579.7064819335938,575.8665161132812,0.9165925383567809,560.4127197265625,564.1045532226562,0.7897042036056519,544.43017578125,552.35595703125,0.8962704539299011,531.8712158203125,540.1428833007811,0.8099266290664673,516.0972900390625,520.5545654296875,0.6749165058135986,383.7297668457031,536.6251220703125,0.885046660900116,399.0272216796875,563.7530517578125,0.8159060478210449,416.0726013183594,575.8941040039062,0.8500763177871704,439.9586791992188,580.58154296875,0.7841462492942809,460.42950439453125,579.9993286132812,0.9021166563034058,479.51409912109375,576.2071533203125,0.9634618163108826,336.4267272949219,543.4904174804689,0.8616150617599487,304.5447998046875,559.779296875,0.8029708266258241,288.0079345703125,563.6052856445312,0.8483252525329591,268.59991455078125,564.447509765625,0.8895316123962402,251.9477996826172,563.3316650390625,0.9515439867973328,235.4656982421875,556.5100708007811,0.9436629414558412
3,496.3336486816406,220.60630798339844,0.9788330197334291,499.9425659179688,264.322021484375,0.804137647151947,500.09765625,292.3538513183594,0.7415158748626709,499.5601196289063,319.8631286621094,0.5986077189445496,496.1994934082031,339.91497802734375,0.2303672730922699,0.0,0.0,0.0,496.3336486816406,220.60630798339844,0.9788330197334291,499.9425659179688,264.322021484375,0.804137647151947,500.09765625,292.3538513183594,0.7415158748626709,499.5601196289063,319.8631286621094,0.5986077189445496,496.1994934082031,339.91497802734375,0.2303672730922699,0.0,0.0,0.0,0.0,0.0,0.0,535.851318359375,376.1219177246094,0.2715684771537781,511.40521240234375,379.5197143554688,0.6323232650756836,483.6984558105469,387.4959411621094,0.6817506551742554,452.0848388671875,391.9915466308594,0.7969747185707092,423.5086975097656,399.751953125,0.931324303150177,0.0,0.0,0.0,635.8026733398438,519.3413696289061,0.8352226018905641,612.049072265625,511.3312683105469,0.7598195672035217,591.0923461914062,500.4587707519531,0.8572355508804321,571.091064453125,492.3470458984375,0.8748998045921326,547.8760375976561,487.6129455566406,0.9061638712882996,595.7015991210938,584.3153076171875,0.4555864632129669,579.4247436523438,576.3525390625,0.8828028440475464,560.09912109375,564.3056640625,0.7970129251480103,544.3431396484375,552.4615478515625,0.9156122803688048,531.9349975585939,540.1621704101561,0.8178607225418091,516.20703125,520.53466796875,0.6942353248596191,387.8775024414063,532.72314453125,0.9184426665306092,400.0733947753906,560.5511474609375,0.8534789681434631,419.3782043457031,575.6778564453125,0.8712479472160339,440.1101379394531,580.6194458007812,0.7905017137527466,460.2353820800781,580.6527709960938,0.9004195332527161,476.6386413574219,579.4889526367188,0.993718922138214,336.3165283203125,543.4000244140625,0.8707237243652344,307.3284606933594,559.9840698242189,0.8165134787559509,288.01300048828125,563.919921875,0.8597572445869446,268.43829345703125,564.7252197265625,0.8994816541671753,251.8329925537109,563.4426879882812,0.9700333476066588,235.3411865234375,556.5420532226561,0.9455788135528564
4,496.3221130371094,220.76739501953125,0.9742648005485536,500.30377197265625,267.73977661132807,0.8045008778572083,500.3703002929688,296.0572509765625,0.7457910180091858,496.38751220703125,324.16619873046875,0.5705496072769165,0.0,0.0,0.0,0.0,0.0,0.0,496.3221130371094,220.76739501953125,0.9742648005485536,500.30377197265625,267.73977661132807,0.8045008778572083,500.3703002929688,296.0572509765625,0.7457910180091858,496.38751220703125,324.16619873046875,0.5705496072769165,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,535.6304321289061,376.6114196777344,0.28071537613868713,511.6216735839844,379.8400268554688,0.6062015891075134,483.7198181152344,387.395263671875,0.6623584032058716,452.0174255371094,391.9966125488281,0.7904066443443298,423.2991943359375,399.8789978027344,0.9169630408287048,0.0,0.0,0.0,636.1013793945312,519.4646606445311,0.8235352039337158,612.2467651367188,511.4793701171875,0.7594605088233948,591.4236450195312,503.55023193359375,0.8789750933647156,571.32177734375,495.489990234375,0.8497058153152466,548.1092529296875,487.7808532714844,0.9143038988113404,595.8994750976562,584.0189208984375,0.4693641066551209,579.4336547851562,576.488525390625,0.89593905210495,560.1011352539061,564.6260375976562,0.7874167561531067,544.1777954101561,552.5606079101561,0.9036816358566284,531.7984008789061,540.2230834960939,0.8270125985145569,516.0720825195311,520.497802734375,0.7120351195335388,391.9834289550781,523.5908813476561,0.9743152260780334,399.96185302734375,555.2852172851561,0.8106785416603088,415.4165649414063,571.713623046875,0.8993117213249207,436.4542236328125,580.239990234375,0.8227529525756836,456.0745544433594,583.6392211914062,0.8926184773445129,472.4842529296875,580.263671875,0.997106432914734,336.2913513183594,544.0748291015625,0.8766992688179016,304.46380615234375,563.096923828125,0.8131293654441833,287.95965576171875,564.5267333984375,0.8448421359062195,268.37100219726557,567.411865234375,0.9186647534370422,251.7641906738281,563.519775390625,0.9665551781654358,235.3104705810547,556.5091552734375,0.9400166273117064
5,496.5477294921875,220.31765747070312,1.0025038719177246,500.3257141113281,267.41021728515625,0.8073557615280151,500.5188293457031,295.65936279296875,0.7421766519546509,499.3809814453125,320.694091796875,0.5579490661621094,496.3204650878906,340.69488525390625,0.2062848061323166,0.0,0.0,0.0,496.5477294921875,220.31765747070312,1.0025038719177246,500.3257141113281,267.41021728515625,0.8073557615280151,500.5188293457031,295.65936279296875,0.7421766519546509,499.3809814453125,320.694091796875,0.5579490661621094,496.3204650878906,340.69488525390625,0.2062848061323166,0.0,0.0,0.0,0.0,0.0,0.0,535.6732177734375,376.5775451660156,0.2895082235336304,511.58978271484375,379.8506774902344,0.6220303177833557,483.64739990234375,387.5206604003906,0.6734927892684937,451.9689636230469,392.08935546875,0.8059420585632324,423.2479553222656,400.1103820800781,0.8917230367660522,0.0,0.0,0.0,636.2506713867188,516.7752075195311,0.8254024386405945,612.2767944335938,511.49456787109375,0.7678549885749817,591.477783203125,503.6936340332031,0.8922142982482909,571.3546142578125,495.6891174316406,0.8556576371192932,548.2413330078125,488.05322265625,0.91047602891922,595.9586181640625,583.460693359375,0.5140318274497986,576.6068115234375,576.3134765625,0.9000992178916931,559.978515625,564.611572265625,0.7706466913223267,543.9149169921875,555.3850708007811,0.91111820936203,531.5545654296875,540.5081787109375,0.8141813278198242,516.129150390625,523.2796020507811,0.6990899443626404,396.3413391113281,512.0481567382811,0.9263705015182496,400.5076599121094,547.2685546875,0.7489035129547119,411.8859252929688,564.2376098632812,0.8736788630485535,432.0379943847656,576.0293579101562,0.7989232540130615,448.5880737304688,583.4317626953125,0.8441069722175598,467.59283447265625,583.3642578125,0.9834716916084291,336.1600341796875,543.789306640625,0.8774490356445312,307.2768859863281,560.6718139648439,0.8090906739234924,287.9517517089844,564.6837158203125,0.8336358666419983,268.23101806640625,567.503173828125,0.9250435829162598,251.68019104003903,563.5968017578125,0.9689670205116272,235.2488555908203,556.5679321289061,0.9312905073165894
...
catubc commented 2 years ago

And here's the one in the root directory where the .slp file is:

,Animal_1_nose_x,Animal_1_nose_y,Animal_1_nose_p,Animal_1_spine1_x,Animal_1_spine1_y,Animal_1_spine1_p,Animal_1_spine2_x,Animal_1_spine2_y,Animal_1_spine2_p,Animal_1_spine3_x,Animal_1_spine3_y,Animal_1_spine3_p,Animal_1_spine4_x,Animal_1_spine4_y,Animal_1_spine4_p,Animal_1_spine5_x,Animal_1_spine5_y,Animal_1_spine5_p,Animal_2_nose_x,Animal_2_nose_y,Animal_2_nose_p,Animal_2_spine1_x,Animal_2_spine1_y,Animal_2_spine1_p,Animal_2_spine2_x,Animal_2_spine2_y,Animal_2_spine2_p,Animal_2_spine3_x,Animal_2_spine3_y,Animal_2_spine3_p,Animal_2_spine4_x,Animal_2_spine4_y,Animal_2_spine4_p,Animal_2_spine5_x,Animal_2_spine5_y,Animal_2_spine5_p,Animal_3_nose_x,Animal_3_nose_y,Animal_3_nose_p,Animal_3_spine1_x,Animal_3_spine1_y,Animal_3_spine1_p,Animal_3_spine2_x,Animal_3_spine2_y,Animal_3_spine2_p,Animal_3_spine3_x,Animal_3_spine3_y,Animal_3_spine3_p,Animal_3_spine4_x,Animal_3_spine4_y,Animal_3_spine4_p,Animal_3_spine5_x,Animal_3_spine5_y,Animal_3_spine5_p,Animal_4_nose_x,Animal_4_nose_y,Animal_4_nose_p,Animal_4_spine1_x,Animal_4_spine1_y,Animal_4_spine1_p,Animal_4_spine2_x,Animal_4_spine2_y,Animal_4_spine2_p,Animal_4_spine3_x,Animal_4_spine3_y,Animal_4_spine3_p,Animal_4_spine4_x,Animal_4_spine4_y,Animal_4_spine4_p,Animal_4_spine5_x,Animal_4_spine5_y,Animal_4_spine5_p,Animal_5_nose_x,Animal_5_nose_y,Animal_5_nose_p,Animal_5_spine1_x,Animal_5_spine1_y,Animal_5_spine1_p,Animal_5_spine2_x,Animal_5_spine2_y,Animal_5_spine2_p,Animal_5_spine3_x,Animal_5_spine3_y,Animal_5_spine3_p,Animal_5_spine4_x,Animal_5_spine4_y,Animal_5_spine4_p,Animal_5_spine5_x,Animal_5_spine5_y,Animal_5_spine5_p,Animal_6_nose_x,Animal_6_nose_y,Animal_6_nose_p,Animal_6_spine1_x,Animal_6_spine1_y,Animal_6_spine1_p,Animal_6_spine2_x,Animal_6_spine2_y,Animal_6_spine2_p,Animal_6_spine3_x,Animal_6_spine3_y,Animal_6_spine3_p,Animal_6_spine4_x,Animal_6_spine4_y,Animal_6_spine4_p,Animal_6_spine5_x,Animal_6_spine5_y,Animal_6_spine5_p
0,496.2355041503906,220.567626953125,0.9527365565299988,500.4596252441406,263.9275207519531,0.8128677010536194,503.2895812988281,292.5050964355469,0.711251437664032,500.05694580078125,320.3348693847656,0.661466658115387,503.6937255859375,343.82562255859375,0.3003198206424713,0.0,0.0,0.0,0.0,0.0,0.0,535.5052490234375,379.9781188964844,0.2975809574127197,508.6451110839844,383.20098876953125,0.5648311972618103,483.367919921875,384.58819580078125,0.6478815674781799,451.70074462890625,391.420654296875,0.7451946139335632,423.4447937011719,399.6026611328125,0.9182761311531067,336.589599609375,543.6217651367188,0.8530907034873962,307.4103698730469,560.0713500976562,0.7831662893295288,288.1627502441406,564.1406860351562,0.8259077072143555,268.6378173828125,567.1624755859375,0.8390766978263855,251.97784423828125,563.4893188476562,0.9189422726631165,235.68455505371094,556.4923095703125,0.9046114683151245,600.7646484375,575.720458984375,0.5423446297645569,583.8673706054688,572.3936157226562,0.7516449689865112,563.8768920898438,567.9528198242188,0.7206470966339111,543.586669921875,556.2380981445312,0.7213824987411499,527.6947631835938,543.9876098632812,0.7564922571182251,515.7238159179688,524.171630859375,0.7290070056915283,384.0461730957031,535.8851928710938,0.8675850033760071,396.2161865234375,559.5531005859375,0.8782817721366882,412.5365295410156,571.8739013671875,0.8699088096618652,436.2445373535156,579.6212158203125,0.7766255736351013,456.49560546875,579.3140869140625,0.883823573589325,475.4640197753906,575.2548828125,0.9269698858261108,648.0948486328125,515.2940063476562,0.22290436923503876,636.2654418945312,516.0468139648438,0.8575764894485474,612.0125732421875,508.645751953125,0.7609681487083435,591.1453857421875,500.4262390136719,0.832747220993042,571.529541015625,495.38739013671875,0.8492857813835144,548.5122680664062,487.8362121582031,0.8720636367797852
1,496.2879638671875,220.63107299804688,0.9547415375709534,500.44415283203125,264.1401672363281,0.8200687766075134,500.6158142089844,295.5201721191406,0.747184693813324,499.6556701660156,320.661865234375,0.6593335270881653,503.5816650390625,344.24212646484375,0.28254279494285583,0.0,0.0,0.0,0.0,0.0,0.0,535.52880859375,379.43389892578125,0.3010869026184082,508.5622863769531,380.3068542480469,0.5687392354011536,483.46014404296875,384.4634704589844,0.6695404052734375,451.8765563964844,391.38427734375,0.7627116441726685,423.4925231933594,399.610595703125,0.9281686544418335,336.52490234375,543.4237670898438,0.8464635014533997,304.5652160644531,559.7457885742188,0.7898238301277161,288.0775146484375,563.6826171875,0.8300068378448486,268.6436767578125,564.4812622070312,0.8552283048629761,251.9909210205078,563.39990234375,0.9223942160606384,235.6182403564453,556.50244140625,0.9146983623504639,596.8784790039062,579.6757202148438,0.45394888520240784,580.1005249023438,575.897705078125,0.8403472304344177,560.4075317382812,567.7429809570312,0.7307121157646179,543.7866821289062,555.66943359375,0.788873016834259,527.8856201171875,543.5237426757812,0.8062229752540588,515.6806030273438,523.9407958984375,0.7190098762512207,380.3003845214844,536.2025146484375,0.8638001084327698,395.5709228515625,559.7769165039062,0.8765522241592407,412.270263671875,571.87744140625,0.8725616931915283,436.11480712890625,576.8961791992188,0.7829010486602783,456.60833740234375,576.468994140625,0.9018959403038025,475.4982604980469,575.1974487304688,0.9149670600891113,0.0,0.0,0.0,636.1993408203125,516.1194458007812,0.8542495369911194,612.2576904296875,508.6696472167969,0.7529775500297546,591.4818725585938,503.501708984375,0.845646858215332,571.4248046875,495.66845703125,0.8548214435577393,548.2125244140625,488.059326171875,0.8840513825416565
2,496.2433776855469,220.63575744628906,0.9665535688400269,499.9832763671875,264.2439270019531,0.8199657201766968,500.14794921875,292.3388671875,0.7738865613937378,499.8458557128906,319.84124755859375,0.6679050326347351,500.36553955078125,340.48931884765625,0.25780370831489563,0.0,0.0,0.0,0.0,0.0,0.0,535.7659301757812,376.22381591796875,0.30282843112945557,508.7102966308594,379.6003112792969,0.6317318081855774,483.5924377441406,387.3358154296875,0.6752269864082336,452.025146484375,391.7570495605469,0.7950249910354614,423.46099853515625,399.7508239746094,0.9333615303039551,336.4267272949219,543.4904174804688,0.8616150617599487,304.5447998046875,559.779296875,0.802970826625824,288.0079345703125,563.6052856445312,0.848325252532959,268.59991455078125,564.447509765625,0.8895316123962402,251.9477996826172,563.3316650390625,0.9515439867973328,235.4656982421875,556.5100708007812,0.9436629414558411,595.5662841796875,584.20361328125,0.4263121783733368,579.7064819335938,575.8665161132812,0.916592538356781,560.4127197265625,564.1045532226562,0.7897042036056519,544.43017578125,552.35595703125,0.8962704539299011,531.8712158203125,540.1428833007812,0.8099266290664673,516.0972900390625,520.5545654296875,0.6749165058135986,383.7297668457031,536.6251220703125,0.885046660900116,399.0272216796875,563.7530517578125,0.8159060478210449,416.0726013183594,575.8941040039062,0.8500763177871704,439.95867919921875,580.58154296875,0.784146249294281,460.42950439453125,579.9993286132812,0.9021166563034058,479.51409912109375,576.2071533203125,0.9634618163108826,0.0,0.0,0.0,635.730712890625,516.7711181640625,0.8310267329216003,612.0079345703125,511.363525390625,0.762147068977356,591.093017578125,500.4256896972656,0.8568326830863953,571.1381225585938,492.3208312988281,0.8802744746208191,547.9884033203125,487.4876708984375,0.9093877077102661
3,496.3336486816406,220.60630798339844,0.978833019733429,499.94256591796875,264.322021484375,0.804137647151947,500.09765625,292.3538513183594,0.7415158748626709,499.56011962890625,319.8631286621094,0.5986077189445496,496.1994934082031,339.91497802734375,0.2303672730922699,0.0,0.0,0.0,0.0,0.0,0.0,535.851318359375,376.1219177246094,0.2715684771537781,511.40521240234375,379.51971435546875,0.6323232650756836,483.6984558105469,387.4959411621094,0.6817506551742554,452.0848388671875,391.9915466308594,0.7969747185707092,423.5086975097656,399.751953125,0.931324303150177,336.3165283203125,543.4000244140625,0.8707237243652344,307.3284606933594,559.9840698242188,0.8165134787559509,288.01300048828125,563.919921875,0.8597572445869446,268.43829345703125,564.7252197265625,0.8994816541671753,251.83299255371094,563.4426879882812,0.9700333476066589,235.3411865234375,556.5420532226562,0.9455788135528564,595.7015991210938,584.3153076171875,0.4555864632129669,579.4247436523438,576.3525390625,0.8828028440475464,560.09912109375,564.3056640625,0.7970129251480103,544.3431396484375,552.4615478515625,0.9156122803688049,531.9349975585938,540.1621704101562,0.8178607225418091,516.20703125,520.53466796875,0.6942353248596191,387.87750244140625,532.72314453125,0.9184426665306091,400.0733947753906,560.5511474609375,0.8534789681434631,419.3782043457031,575.6778564453125,0.8712479472160339,440.1101379394531,580.6194458007812,0.7905017137527466,460.2353820800781,580.6527709960938,0.9004195332527161,476.6386413574219,579.4889526367188,0.9937189221382141,0.0,0.0,0.0,635.8026733398438,519.3413696289062,0.835222601890564,612.049072265625,511.3312683105469,0.7598195672035217,591.0923461914062,500.4587707519531,0.8572355508804321,571.091064453125,492.3470458984375,0.8748998045921326,547.8760375976562,487.6129455566406,0.9061638712882996
4,496.3221130371094,220.76739501953125,0.9742648005485535,500.30377197265625,267.7397766113281,0.8045008778572083,500.37030029296875,296.0572509765625,0.7457910180091858,496.38751220703125,324.16619873046875,0.5705496072769165,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,535.6304321289062,376.6114196777344,0.28071537613868713,511.6216735839844,379.84002685546875,0.6062015891075134,483.7198181152344,387.395263671875,0.6623584032058716,452.0174255371094,391.9966125488281,0.7904066443443298,423.2991943359375,399.8789978027344,0.9169630408287048,336.2913513183594,544.0748291015625,0.8766992688179016,304.46380615234375,563.096923828125,0.8131293654441833,287.95965576171875,564.5267333984375,0.8448421359062195,268.3710021972656,567.411865234375,0.9186647534370422,251.76419067382812,563.519775390625,0.9665551781654358,235.3104705810547,556.5091552734375,0.9400166273117065,595.8994750976562,584.0189208984375,0.46936410665512085,579.4336547851562,576.488525390625,0.89593905210495,560.1011352539062,564.6260375976562,0.7874167561531067,544.1777954101562,552.5606079101562,0.9036816358566284,531.7984008789062,540.2230834960938,0.8270125985145569,516.0720825195312,520.497802734375,0.7120351195335388,391.9834289550781,523.5908813476562,0.9743152260780334,399.96185302734375,555.2852172851562,0.8106785416603088,415.41656494140625,571.713623046875,0.8993117213249207,436.4542236328125,580.239990234375,0.8227529525756836,456.0745544433594,583.6392211914062,0.8926184773445129,472.4842529296875,580.263671875,0.9971064329147339,0.0,0.0,0.0,636.1013793945312,519.4646606445312,0.8235352039337158,612.2467651367188,511.4793701171875,0.7594605088233948,591.4236450195312,503.55023193359375,0.8789750933647156,571.32177734375,495.489990234375,0.8497058153152466,548.1092529296875,487.7808532714844,0.9143038988113403
5,496.5477294921875,220.31765747070312,1.0025038719177246,500.3257141113281,267.41021728515625,0.8073557615280151,500.5188293457031,295.65936279296875,0.7421766519546509,499.3809814453125,320.694091796875,0.5579490661621094,496.3204650878906,340.69488525390625,0.2062848061323166,0.0,0.0,0.0,0.0,0.0,0.0,535.6732177734375,376.5775451660156,0.28950822353363037,511.58978271484375,379.8506774902344,0.6220303177833557,483.64739990234375,387.5206604003906,0.6734927892684937,451.9689636230469,392.08935546875,0.8059420585632324,423.2479553222656,400.1103820800781,0.8917230367660522,336.1600341796875,543.789306640625,0.8774490356445312,307.2768859863281,560.6718139648438,0.8090906739234924,287.9517517089844,564.6837158203125,0.8336358666419983,268.23101806640625,567.503173828125,0.9250435829162598,251.68019104003906,563.5968017578125,0.9689670205116272,235.2488555908203,556.5679321289062,0.9312905073165894,595.9586181640625,583.460693359375,0.5140318274497986,576.6068115234375,576.3134765625,0.9000992178916931,559.978515625,564.611572265625,0.7706466913223267,543.9149169921875,555.3850708007812,0.91111820936203,531.5545654296875,540.5081787109375,0.8141813278198242,516.129150390625,523.2796020507812,0.6990899443626404,396.3413391113281,512.0481567382812,0.9263705015182495,400.5076599121094,547.2685546875,0.7489035129547119,411.88592529296875,564.2376098632812,0.8736788630485535,432.0379943847656,576.0293579101562,0.7989232540130615,448.58807373046875,583.4317626953125,0.8441069722175598,467.59283447265625,583.3642578125,0.983471691608429,0.0,0.0,0.0,636.2506713867188,516.7752075195312,0.8254024386405945,612.2767944335938,511.49456787109375,0.7678549885749817,591.477783203125,503.6936340332031,0.892214298248291,571.3546142578125,495.6891174316406,0.8556576371192932,548.2413330078125,488.05322265625,0.91047602891922
catubc commented 2 years ago

Anyways, I'm open to any other suggestions. Thanks so much for the help.

sronilsson commented 2 years ago

There is something going on in how you defined the body-parts for the first animal. The last integer is the animal number (SimBA uses this integer to keep the animals separated): So you have an AnimalName_BodyPartName_AnimalInteger. You see that the female for some reason has an extra digit:

image.

sronilsson commented 2 years ago

Open the file, change female to this below, save file, and try and run it again.

image

catubc commented 2 years ago

Thanks, not sure where that's from, seems simba is generating these extra indexes.

I changed it all and it's still crashing on this elements issue:

female_nose_1
female_spine1_1
female_spine2_1
female_spine3_1
female_spine4_1
female_spine5_1
male_nose_2
male_spine1_2
male_spine2_2
male_spine3_2
male_spine4_2
male_spine5_2
pup1_nose_3
pup1_spine1_3
pup1_spine2_3
pup1_spine3_3
pup1_spine4_3
pup1_spine5_3
pup2_nose_4
pup2_spine1_4
pup2_spine2_4
pup2_spine3_4
pup2_spine4_4
pup2_spine5_4
pup3_nose_5
pup3_spine1_5
pup3_spine2_5
pup3_spine3_5
pup3_spine4_5
pup3_spine5_5
pup4_nose_6
pup4_spine1_6
pup4_spine2_6
pup4_spine3_6
pup4_spine4_6
pup4_spine5_6

Here's the log again


(simba3) cat@cat-Precision-T3610:~$ simba
Qt: Session management error: None of the authentication protocols specified are supported
Exception in Tkinter callback
Traceback (most recent call last):
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/tkinter/__init__.py", line 1705, in __call__
    return self.func(*args)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/SimBA.py", line 3895, in <lambda>
    button_skipOC = Button(label_outliercorrection,text='Skip outlier correction (CAUTION)',fg='red', command=lambda:skip_outlier_c(self.projectconfigini))
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/outlier_scripts/skip_outlierCorrection.py", line 61, in skip_outlier_c
    csv_df.columns = newHeaders
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/generic.py", line 5192, in __setattr__
    return object.__setattr__(self, name, value)
  File "pandas/_libs/properties.pyx", line 67, in pandas._libs.properties.AxisProperty.__set__
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/generic.py", line 690, in _set_axis
    self._data.set_axis(axis, labels)
  File "/media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/pandas/core/internals/managers.py", line 183, in set_axis
    "values have {new} elements".format(old=old_len, new=new_len)
ValueError: Length mismatch: Expected axis has 126 elements, new values have 108 elements
sronilsson commented 2 years ago

Hmm.. what I would suggest:

For this file with the entries below, your paste suggest that there is an extra empty None row right at the end. Can you attach the actual CSV file here and I can check it?

Also, if I had to troubleshoot this myself, I would: 1: Open this file: /media/cat/4TBSSD/anaconda3/envs/simba3/lib/python3.6/site-packages/simba/outlier_scripts/skip_outlierCorrection.py

  1. Right before line 61 (csv_df.columns = newHeaders), insert a new line: print(newHeaders)

  2. Save, and re-run the outlier correction, and you'll see printed out what the hell the extra columns that SimBA is trying to use are. 

female_spine1_1
female_spine2_1
female_spine3_1
female_spine4_1
female_spine5_1
male_nose_2
male_spine1_2
male_spine2_2
male_spine3_2
male_spine4_2
male_spine5_2
pup1_nose_3
pup1_spine1_3
pup1_spine2_3
pup1_spine3_3
pup1_spine4_3
pup1_spine5_3
pup2_nose_4
pup2_spine1_4
pup2_spine2_4
pup2_spine3_4
pup2_spine4_4
pup2_spine5_4
pup3_nose_5
pup3_spine1_5
pup3_spine2_5
pup3_spine3_5
pup3_spine4_5
pup3_spine5_5
pup4_nose_6
pup4_spine1_6
pup4_spine2_6
pup4_spine3_6
pup4_spine4_6
pup4_spine5_6
catubc commented 2 years ago

Hi. Re: the printout, here's the screen grabs Screenshot from 2021-12-20 21-11-50 Screenshot from 2021-12-20 21-13-02 .

catubc commented 2 years ago

I should also mention that I'm using a special branch of Talmo's code that was developed specifically for our lab. It does bottom-up + ID prediction, and the code I think is still stuck in Ver1.1.0. Perhaps there are some incompatibilities there.

I put both the .mp4 and the .slp files here (should be uploaded in 5mins):

https://drive.google.com/drive/folders/1VwAq2CuVRCdQlyr6xVQ1OT6FHn8HS4HD?usp=sharing

If you have any other suggestions or have a moment to try and load them, I'd really appreciate it. Thanks so much!

sronilsson commented 2 years ago

Thanks, could you also send me the CSV file, the one inside the project_foldet/csv/input_csv, the one with the SLEP_multi in the top two lines, that I saw in one screenshot?

catubc commented 2 years ago

Ok, I uploaded both the csvs here:

https://drive.google.com/drive/folders/1VwAq2CuVRCdQlyr6xVQ1OT6FHn8HS4HD?usp=sharing

The one inside the input_csv folder is labeled as such, and the one outside in the main location where the SLEAP and video files are has .csv instead of .slp. (I also saved the entire project directory as gerbils4.zip).

Thanks so much, I'm excited to get this fixed and do some tracking.

sronilsson commented 2 years ago

Thanks! Yes we should be able to get this going, thanks for reporting the issues btw.

From what I can see on my phone, the CSV file contains a duplicate of the "female", and this is most likely what is causing the issue. If you scan the headers you'll see two "female" with identical body part coordinates. This issue could have been caused by SimBA, or be present in the the SLP h5 tracking file to begin with. I will look at the SLP h5 to start, but can only do that from a desktop and won't be for a day or so.

If you want to go ahead without me, try deleting the columns representing the duplicate female in the project_folder/csv/input_csv file and it should work to proceed with the skip outlier correction

catubc commented 2 years ago

Hi, thanks for this. I quickly deleted the extra female on inside .csv, but same error. I think actually the rest of the headers also have extra fields (the "SLEAP_multi" parts). These are a bit more tricky to delete as I have to count. If you could find the bug that would be great, otherwise I'll try to get to it later (I am doing wetlab work for the next bit). Thanks so much! catubc

catubc commented 2 years ago

Hi @sronilsson So I was able to get past the duplication issue finally. You were correct, there seems to be a bug somewhere that duplicates the first animal (in our case, the "female" gerbil).

I wrote a quick-and-dirty function for now to fix this duplication so we can test the rest of your pipeline, see below. It loads the simba-outputed CSV and removes the duplicate animal.

I would prefer to have a permanent fix, if you could guide me to the location where you think this happens I could try and fix+pull request it.

Thanks so much, catubc

def fix_simba_duplicate_animal_from_sleap(fname, 
                                          n_animals,
                                          n_features):

    import csv, os

    # read csv
    file = open(fname)
    csvreader = csv.reader(file)
    rows = []
    for row in csvreader:
        rows.append(row)
    file.close()

    # find rows where incorrect # of animals are present
    for k in trange(len(rows)):
        if len(rows[k])!=(1+n_animals*n_features*3):
            temp = rows[k].copy()
            temp = np.delete(temp,np.arange(1,1+n_features*3,1))  # delete the first duplicate occurance of animal #1
            rows[k] = temp

    # 
    with open(fname, 'w') as f:
        writer = csv.writer(f)
        for row in tqdm(rows):
            writer.writerow(row)

#######################################################
project_dir = '/media/cat/256GB/dan/simba/cohorts/gerbils4/'
video_name = '2020_08_01_11_27_15_857870_compressed_corrected.mp4'

fname = os.path.join(project_dir,
                     'project_folder/csv/input_csv',
                     video_name.replace('mp4','csv'))
n_animals = 6
n_features = 6

fix_simba_duplicate_animal_from_sleap(fname,
                                     n_animals,
                                     n_features)
sronilsson commented 2 years ago

Excellent if you do a PR I'd be grateful and review and merge and add to pip package too, I'd just avoid tqdm as its not currently a requirement. It should work if you call fix_simba_duplicate_animal_from_sleap after here:

https://github.com/sgoldenlab/simba/blob/4cac1f8c7864d752bdb49251d4f3b098f7041124/simba/sleap_bottom_up_convert.py#L333

or after this:

https://github.com/sgoldenlab/simba/blob/4cac1f8c7864d752bdb49251d4f3b098f7041124/simba/sleap_bottom_up_convert.py#L340

Sorry did not have time to look myself as traveling for xmas.