wshilton / andrew

GNU General Public License v3.0
0 stars 0 forks source link

Tune +-DOA regions with first Haar cascade filter #3

Closed wshilton closed 1 year ago

wshilton commented 1 year ago

Ensure that the +-DOA regions identified by the acoustic and microwave sensors are of a size that leads to efficient detection by the human body Haar cascade filter.

wshilton commented 1 year ago

Mask RCNN's success in object detection and segmentation resolves the use of the microwave sensor here. In particular, a trained M-RCNN can be applied on an optical data stream with a projection that is cued acoustically. M-RCNN also replaces the Haar cascade filter.

wshilton commented 1 year ago

Since we are adopting DeepFace, we shall require M-RCNN to detect and segment only for human bodies for later body language analysis.

wshilton commented 1 year ago

Since we are adopting DeepFace, we shall require M-RCNN to detect and segment only for human bodies for later body language analysis.

Also subject DeepFace processes only to those regions positively matched by M-RCNN.

wshilton commented 1 year ago

Detectron2's DensePose performs the relevant detection, segmentation, mask generation, and pose estimation here.

wshilton commented 1 year ago

Google's MediaPipe pose landmark detection is an alternative to be considered.

wshilton commented 1 year ago

Pre-trained pose and hand landmark detection networks work sufficiently well to the extent that only integration work remains. Integration issues for this topic will now be raised on a case-by-case basis.