How to calculate the AUE-(L/U)

Fictionarry / TalkingGaussian

[ECCV'24] TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splatting

https://fictionarry.github.io/TalkingGaussian/

213 stars 28 forks source link

How to calculate the AUE-(L/U) #22

Open Net-Maker opened 2 months ago

Net-Maker commented 2 months ago

Hello, I saw AUE and Sync metrics in the paper. Is there any ready-made code that can calculate these metrics? I want to integrate the logic into metrics. py

Fictionarry commented 2 months ago

Hi, since AUE and Sync rely on third-party repos, merging them into metrics.py may make the program too bloated. I'll upload the script for AUE later. Sync-C and Sync-E are measured using https://github.com/joonson/syncnet_python. To measure Sync, you may need to add the corresponding audio to the silent generated video first.

Net-Maker commented 2 months ago

Thanks， that helps a lot