evonneng / learning2listen

Official pytorch implementation for Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion (CVPR 2022)
107 stars 9 forks source link

Usage of List of Files #4

Closed Daksitha closed 2 years ago

Daksitha commented 2 years ago

Hi @evonneng, I was wondering what is the usage of p*_speak_files_clean_deca.npy files?

I am creating my own dataset, therefore, was wondering should I generate a file similar to this for every speaker in my dataset as well?

If I understood correct, this contains the file path, speaker location and number of frames of a particular speaker, is that correct?

evonneng commented 2 years ago

Hi! Thank you for your interest in our paper. Your understanding of the files.npy is correct! I mainly used them to correspond the processed data with the raw videos. It's not necessary to use during training. Hope that helps! Best, Evonne