sucv / ABAW3

We achieved the 2nd and 3rd places in ABAW3 and ABAW5, respectively.
18 stars 4 forks source link

there is no such file #11

Open Jesayy opened 2 months ago

Jesayy commented 2 months ago

Hello, after data preprocessing, I obtained a file named video128.npy. Will this file be used in the subsequent steps? Because in the following steps, I noticed it requires a file named video.npy, however, I do not have this file. Furthermore, I noticed that in the subsequent steps, the file video128.npy is not used. Where should the visual features, which are input into the model, be obtained from?

PoloWlg commented 2 months ago

Hi @Jesayy, got the same issue.

Did you figure out how to use the video features ?

sucv commented 1 month ago

video or video128 tells the data loader to load npy files with the same names. I.e., if the preprocessing generated example.npy and you want to feed it to the model, simply add example to -modalities.

Also add the corresponding keys and values to modifiers and feature_dimension, tcn and tcn_settings from config.py.