search

ubicomplab / rPPG-Toolbox

rPPG-Toolbox: Deep Remote PPG Toolbox (NeurIPS 2023)
https://arxiv.org/abs/2210.00716
Other
442 stars 106 forks source link

How to get HRV or BPM on your own video? #208

Closed syami closed 11 months ago

syami commented 12 months ago

Hi, I could not find any documentation on how to obtain HRV or BPM using an existing trained model on your own video. Can you point me to the correct documentation?

yahskapar commented 11 months ago

Hi @syami,

Since this toolbox is targeted toward effectively designing and benchmarking algorithms for remote photoplethysmography (rPPG), we don't readily have any kind of feature that gives you those results on a self-recorded video or other videos not explicitly captured for rPPG. However, if you treat your custom video, or videos plural, as a dataset, you should be able to obtain results on your video using a mixture of the instructions here and either utilizing unsupervised methods or treating your custom method as an unsupervised method based on the instructions here. Excuse the typo on the step numbering, that will be fixed in a future revision of the README.

Alternatively, you could follow the same aforementioned custom dataset instructions and instead use pseudo-PPG labels as described briefly here. A simple example of how to enable that can be seen in some of the BP4D dataset training config files, for example here.

Give those options a try and feel free to reach out here again with specific questions. All the best!

yahskapar commented 11 months ago

I'll go ahead and close this given the lack of discussion, but feel free to re-open and comment again if you happen to have any questions after going through the information in my previous reply, @syami.