Background image credits - Les Chevaliers du Ciel

Easy, fast and efficient Head Tracking application using only webcam

Status

Last Updated - 6 June, 2024

• Recent Updates
  • [x] Supporting Linux and Apple Silicon
  • [x] Fixing bug causing reduced performance #78

Usage

1. Visit the releases page and download the latest version on your platform. For Windows, a .msi installer will be provided, simply double-click on the installer and follow the installation steps. After Installing, you can simply run StableView from the start menu.

   • Make sure you have internet connectivity while installing the application as it downloads the model weights for the first time.

2. The application uses opentrack to send the tracking data to respective applications. Please install it from their Github repo.

   After installing OpenTrack, select Input as UDP over network so that OpenTrack can receive data from StableView and send it to the required application.

Linux

Run the following command in the terminal inside the folder:

LD_LIBRARY_PATH=. ./StableView

MacOS ( Apple Silicon )

Run the following command in the terminal inside the folder:

DYLD_FALLBACK_LIBRARY_PATH=. ./StableView

Features

• Uses your regular old webcam with AI for head tracking. Uses an extremely low CPU (<3%-60fps in Ryzen 5 3600H) and returns high performance.
• Works with opentrack to run on any modern simulator including Microsoft Flight Simulator, Digital Combat Simulator, Xplane & more.
• Easy to install :)

Shoutouts

• Thanks to the authors of the paper 3DDFA_V2 : Towards Fast, Accurate and Stable 3D Dense Face Alignment, without them, this application wouldn't have been possible, the majority of the model inference code is based on their work. Thanks, Jianzhu Guo, Xiangyu Zhu, Yang Yang, Fan Yang, Zhen Lei and Stan Z. Li.
• Rust Faces by rustybuilder face detection in rust, used to recapture the face when it's lost.
• Sniffer for GUI inspirations, code structure, readme, etc.
• ChatGPT for assisting me to convert some of the Python code to Rust.
• Product Icon from Leonardo Yip on Unsplash.

Bug Report

If you see an error message or run into an issue, please open a new issue. This effort is valued and helps all the users.

Feature Request

If you have any idea or a missing feature you would like to see, please submit a feature request or discuss it with other users.

Contributing

Contributions are greatly appreciated! If you want to contribute to the project, please read Contributing.md for more details.

Contributors

Thanks to all the people who contributed to the project.

License

StableView is open-source and free software released under the MIT License.

Citations

@inproceedings{guo2020towards,
    title =        {Towards Fast, Accurate and Stable 3D Dense Face Alignment},
    author =       {Guo, Jianzhu and Zhu, Xiangyu and Yang, Yang and Yang, Fan and Lei, Zhen and Li, Stan Z},
    booktitle =    {Proceedings of the European Conference on Computer Vision (ECCV)},
    year =         {2020}
}

@misc{3ddfa_cleardusk,
    author =       {Guo, Jianzhu and Zhu, Xiangyu and Lei, Zhen},
    title =        {3DDFA},
    howpublished = {\url{https://github.com/cleardusk/3DDFA}},
    year =         {2018}
}