search

AIRLegend / aitrack

6DoF Head tracking software
MIT License
1.03k stars 102 forks source link

Could the software detect two faces? #120

Open frankzhang196 opened 2 years ago

frankzhang196 commented 2 years ago

I studied the source code and found the number of faces detected is 1, could I detect 2 faces in the camera view?

AIRLegend commented 2 years ago

Why would that be needed? I mean, I suppose you're talking about having two tracking data streams. However, I don't see how that could be compatible with opentrack as it only allows a single data stream.

frankzhang196 commented 2 years ago

Why would that be needed? I mean, I suppose you're talking about having two tracking data streams. However, I don't see how that could be compatible with opentrack as it only allows a single data stream. Thanks for your reply! You mean, enve if I change the source code to detect 2 faces, will not use opentrack to tracking 2 faces. Its helpful, thank you. I am interested in the models for detecting face and landmarks, could you share related papers or docs about the architecture of the model?

searching46dof commented 1 year ago

To frankzhang196, You may want to try version 0.6.6alpha which uses cv:FaceDetectorYN and detects multiple faces. In addition to modifying aitrack to output multiple data streams, you would need to add some configuration/intelligence to associate a face to a specific data stream.

I submitted changes for adding center weighting (post version 0.6.6) by detecting the face closest to the center of the preview window. It could be enhanced to detect the face closest to multiple points in the preview window.

frankzhang196 commented 1 year ago

To frankzhang196, You may want to try version 0.6.6alpha which uses cv:FaceDetectorYN and detects multiple faces. In addition to modifying aitrack to output multiple data streams, you would need to add some configuration/intelligence to associate a face to a specific data stream.

I submitted changes for adding center weighting (post version 0.6.6) by detecting the face closest to the center of the preview window. It could be enhanced to detect the face closest to multiple points in the preview window.

thanks!

DrJaymz commented 1 year ago

I would like a setting that if it sees two it just returns centre position. Because if I'm on the flight simulator and one of my kids comes in it goes completely nuts.

searching46dof commented 1 year ago

@DrJaymz , version 0.7.0 already implemented center weighted face tracking

DrJaymz commented 1 year ago

I haven't had the kids come in with the latest version. The kids just think I sit there crashing the plane all night.