search

ubicomplab / rPPG-Toolbox

rPPG-Toolbox: Deep Remote PPG Toolbox (NeurIPS 2023)
https://arxiv.org/abs/2210.00716
Other
414 stars 99 forks source link

On the issue of facial cropping #282

Closed moon-ligh closed 1 month ago

moon-ligh commented 1 month ago 
    Hello, I see that almost all configuration files in the code will be set  USE_LARGE_FACE_BOX: True ,LARGE_BOX_COEF: 1.5.

The video after being cropped in this way is generally as follows: image Besides the facial part, there are also background colors or shoulders. I'm curious why only the facial part is cropped out, like this: image What is the specific reason?

girishvn commented 1 month ago

This method is most useful for unsupervised methods / signal processing methods like CHROM / POS / etc, where cropping out background can result in higher SNRs.

This is less true for attention based models such as TSCAN and DeepPhys which learn to isolate the face through attention (however these may also benefit slightly from background crop).

moon-ligh commented 1 month ago

I see. Thank you

yahskapar commented 1 month ago

I'll go ahead and close this issue since it seems like the original question was addressed, but feel free to create a new issue if anything else comes to mind. Thanks!