dabit-lucas / hac

Human Action Controller
Apache License 2.0
26 stars 4 forks source link

how to run demo on ubuntu? #25

Open lucasjinreal opened 3 years ago

lucasjinreal commented 3 years ago
/pydirectinput/__init__.py", line 6, in <module>
    SendInput = ctypes.windll.user32.SendInput
AttributeError: module 'ctypes' has no attribute 'windll'

one dependence will using windll which not exist on ubuntu

chenjiunhan commented 3 years ago

Thanks for testing it on ubuntu, I'll make sure it support ubuntu as soon as possible.

chenjiunhan commented 3 years ago

Hi @jinfagang, I wrote the code to make it work on Ubuntu. I tested it on Ubuntu 18.04, python 3.7 with virtual environment.

you can pull the new code, reinstall pyhac with pip, and run the demo with

python demo.py
lucasjinreal commented 3 years ago

@chenjiunhan thank u. I am really interested in this project, I want make it into real production use, here are some problems I found when I use it myself.

1). the mouse point are really shinking, it hard to focus on a point using hand, maybe some Debouncing algorithm can be added?

2). To be honest, I think it would be much more useful if there are some quick gestures added same as mac touchpad, such as switch desktop workspace / open task glance view / minimal or maxiumal a window, then it can be much more useful in real life

chenjiunhan commented 3 years ago

1). I understand. the jittering comes from the slight difference of every frame of skeleton detection, even we are not moving. I do want to add an algorithm to fix this, also separate slow mode for the accurate mouse control. Do you have any idea about what algorithm I can try?

2). I agree. Now I am also narrowing down the applications of Pyhac. One suggestion from a Redditor is smart mirror like this. Another thought is to enhance interactions between streamer and fans, but I'm still work on a prototype on it. The one you mention, I'm interested in as well, it depends on if there are some python libraries that we can control GUI on Ubuntu, Windows, and other platforms?

@jinfagang