search

aiden200 / 2D3MF

Code and models for the paper "2D3MF: Deepfake Detection using Multi Modal Middle Fusion"
Other
31 stars 1 forks source link

Emotion2vec #39

Closed cy3021561 closed 7 months ago

cy3021561 commented 7 months ago

Update relative functions for emotion2vec model usage. ( emotion2vec feature shape: [TEMPORAL_WINDOW_SIZE, 768] )

  1. Add two libraries --> requirement.txt
  2. Add emotion2vec model class --> src/emotion2vec/emotion2vec.py
  3. Update hidden_layer dimension for emotion2vec --> model/classifier.py
  4. Update emotion2vec feature extraction --> preprocess/extract_features.py
  5. Add padding and truncate logic to have a fixed emotion2vec feature shape -->dataset/celebv_hq.py
cy3021561 commented 7 months ago

Add video feature padding and truncate logic -->dataset/celebv_hq.py