ubicomplab / rPPG-Toolbox

rPPG-Toolbox: Deep Remote PPG Toolbox (NeurIPS 2023)
https://arxiv.org/abs/2210.00716
Other
503 stars 127 forks source link

palmvein #234

Closed peizhengfu closed 11 months ago

peizhengfu commented 11 months ago

Hello, I want to use this toolbox to extract rppg from palm veins. Is it feasible?

yahskapar commented 11 months ago

Hi @peizhengfu,

It should be feasible to explore. I'd recommend seeing if you can extract a signal using an unsupervised method like POS first, then moving on to neural methods and either trying a pre-trained model to see if it can get any reasonable signal (unlikely) or trying to train, or fine-tune, a model on data that has palm veins captured.

You should definitely take a look at this full body cardiovascular sensing paper which has a multi-site physiological monitoring (MSPM) dataset associated with it. I haven't read this other paper here that cited the aforementioned paper yet, but it also looks interesting and appears to include measurement of the palm in addition to a novel measurement of the foot sole.

Since there appears to be a fair amount of questions regarding non-face sites for rPPG, we will try to add dataset support for MSPM or other similar datasets in the near future.

peizhengfu commented 11 months ago

Thank you very much for your feedback and suggestions