Rehab-Robotics-Lab / FloAssessmentPipeline

This is the pipeline for assessing patient function based on data from the FloSystem
1 stars 0 forks source link

Add detectron2 #64

Open mjsobrep opened 2 years ago

mjsobrep commented 2 years ago

Want to do hand/body tracking with detectron2

mjsobrep commented 2 years ago

We would want to use R101-FPN from https://github.com/facebookresearch/detectron2/blob/main/MODEL_ZOO.md#coco-person-keypoint-detection-baselines-with-keypoint-r-cnn Could also try the X101 model, but its performance is not much better for the large jump in compute cost.

A nice example of how to get detectron running is here: https://colab.research.google.com/drive/16jcaJoc6bCFAQ96jDe2HwtXj7BMD_-m5#scrollTo=GYJrlXZC5M-J&line=3&uniqifier=1

mjsobrep commented 2 years ago

Things that may need to be added: