search

smellslikeml / ActionAI

Real-Time Spatio-Temporally Localized Activity Detection by Tracking Body Keypoints
https://www.hackster.io/actionai/actionai-custom-tracking-multiperson-activity-recognition-fa5cb5
GNU General Public License v3.0
772 stars 192 forks source link

[Question]Parsing good poses and poses from LSTM module ? #24

Open timtensor opened 4 years ago

timtensor commented 4 years ago

Hi , I am trying to extend theLSTM moduleand was wondering if it could be used to make a simple parser ,to differentiate Good posture and Bad Posture.

What i have is lets say Ref Videowhich lets say is a sequence of situps done correctly and test video where some situups are wrong (ex 3/10 ) . I am extracting the normalized keypoints injson format x, y co-ordinates and confidence score (Coco -posenet format )per frame for both reference and test video .

I want to extract the those 3 bad situps. Is it possible to do so ?? If so could you provide me the guidance.

gohjiayi commented 4 years ago

I think that it is possible by training the model with data for good and bad situps. It will be hard though because of the similarity between good/bad posture and the fact that pose estimation flickers a lot when joints are not detected.

I'm looking to implement posture correction & rep counting but not too sure on how to do so. Any help is appreciated, looking forward.

timtensor commented 4 years ago

@gohjiayi sorry for the late reply. I kind of discontinued after struggling on distinguishing on goodbad poses. I was looking to explore more the action recognition side of things. I saw you had made some progress, perhaps i can DM you ?

gohjiayi commented 4 years ago

@timtensor Sure, reach me via contact methods linked on my profile. Cheers!