Can AVE be used with live audio setup in the GUI?

ZiqiaoPeng / SyncTalk

[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"

https://ziqiaopeng.github.io/synctalk/

Other

1.2k stars 138 forks source link

Open varunjain99 opened 2 months ago

varunjain99 commented 2 months ago

Can AVE be used to run the model in real time?

In particular, in the GUI based code path that streams audio, it seems like it isn't possble in the ASR class: https://github.com/ZiqiaoPeng/SyncTalk/blob/60a0a73ed1dc21008645adce91b35aa9a09c9b4b/nerf_triplane/asr.py#L35

Is this a limitation of AVE or has it just not be integrated into the GUI based code path

@ZiqiaoPeng

duany049 commented 1 month ago

anything update？