search

yinguobing / head-pose-estimation

Realtime human head pose estimation with ONNXRuntime and OpenCV.
MIT License
1.24k stars 288 forks source link

Controlling mouse with headpose angle #28

Closed SaddamBInSyed closed 4 years ago

SaddamBInSyed commented 4 years ago

Hi @yinguobing ,

Thanks for the great work.

I want to control my mouse move with my head pose angle . I need your advice on this?

thanks

yinguobing commented 4 years ago

I'm not familiar with mouse control, maybe more details could be helpful.

SaddamBInSyed commented 4 years ago

@yinguobing

Thanks for your reply.

I want to convert the headpose angles (pitch, yaw) into desktop pc screen coordinates ( e.g 1920*1080 resolution)

Due to covid19 problem, user don't want to touch the kiosk application instead they can use their head (pose) to control the kiosk/pc mouse to click/scroll/move

Hope you get my requirement

Thank you.

yinguobing commented 4 years ago

Is it possible to post a screenshot of the application here?

I think most applications like this would use touch screens rather than a mouse.

SaddamBinSyed notifications@github.com于2020年5月9日 周六上午1:51写道：

@yinguobing https://github.com/yinguobing

Thanks for your reply.

I want to convert the headpose angles (pitch, yaw) into desktop pc screen coordinates ( e.g 1920*1080 resolution)

Due to covid19 problem, user don't want to touch the kiosk application instead they can use their head (pose) to control the kiosk/pc mouse to click/scroll/move

Hope you get my requirement

Thank you.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/yinguobing/head-pose-estimation/issues/28#issuecomment-625937899, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACOK2BRYYSLJJTNBCJI55EDRQRBC3ANCNFSM4M4DJ2YQ .

SaddamBInSyed commented 4 years ago

Hi. I am trying to build the application similar to the below.

https://www.youtube.com/watch?v=_WipkZU2pzQ (please have a look into the above)

but instead of hand gesture I want headpose gesture.

thanks

SaddamBInSyed commented 4 years ago

Highly appreciated your response on this.

yinguobing commented 4 years ago

I've watched the video. Have the author released the code? I have no experience of mouse control with python, and I think head pose could only provide directions of movement，not exact pixels the cursor moved.

SaddamBInSyed commented 4 years ago

I found a way to do this. but thanks again