metanav / hovergames2_thermal_face_detection

This is a demo application using Tensorflow Lite to measure face temperature accurately using a low resolution thermal camera
BSD 3-Clause "New" or "Revised" License
1 stars 0 forks source link

NXPHoverGames: Face Thermal Measurement

In this project, I built an application which can be used to measure the temperature of a human face from thermal camera readings and can accurately measure person temperature by extrapolating the facial skin temperature. This application has many use-cases for example, it can be used to search and rescue a person in dark or low light condition where generic digital camera may not work. It can be used as a contactless temperature monitoring. This application also serve as a demo for use of Tensorflow Lite on RDDRONE-8MMNavQ "NavQ" Linux companion computer platform based on NXP i.MX 8M Mini SOC. Please see the complete project story at https://www.hackster.io/naveenbskumar/nxphovergames-face-thermal-measurement-69d0ed

Note: The BlazeFace TensorFlow Lite model used in the application was downloaded from https://github.com/google/mediapipe

Thermal Camera Setup

The MLX90640 thermal camera is connected to the NavQ using a 9-pin JST-GH cable. Note: The 5 unused wires have been cut off to keep the connection clean.

Connection Schematics

Run application

git clone https://github.com/metanav/hovergames2_thermal_face_detection.git
cd hovergames2_thermal_face_detection.git
sudo python3 main.py

Test flight

Test

Full video: https://youtu.be/uLdP8SNedew

Inferencing Demo

The inferencing rate is 17 FPS which is quite impressive for such a low powered 8MMNavQ.

Demo