Sxjdwang TalkLip issues

Sxjdwang / TalkLip

372 stars 34 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Demo code failed to run

#45 Axcdf opened 1 month ago
2
Inconsistency Between Input and Output Video

#44 vaydingul opened 4 months ago
1
How does task state.pt come from?

#43 Yangxiaoda1 opened 4 months ago
1
size mismatch for audio_encoder.w2v_model.encoder.layers: copying a param with shape torch.Size([1024, 1024]) from checkpoint, the shape in current model is torch.Size([768, 768]).

#42 Yangxiaoda1 closed 4 months ago
0
Ouput frames are not synced with Audio

#41 Mostafa-Alavi opened 4 months ago
1
我们创建了一个中文讨论组，有需要的加我微信douzijun1999

#40 dousang1999 opened 5 months ago
0
Task state has no factory for attribute target_dictionary

#39 Yangxiaoda1 closed 5 months ago
3
About lip-reading expert

#38 Rookie-Kai closed 6 months ago
1
Effect of FaceFormer in the paper

#37 Nyquist0 opened 7 months ago
4
Severe Blur in the mouth area

#36 Nyquist0 opened 7 months ago
3
[Bug] TypeError: 'NoneType' object is not subscriptable in "utils /data_avhubert.py"

#35 LZY-WHU closed 8 months ago
1
The results of the generation are not aligned. Why do you need to adjust the bbx when post-processing the fused face?

#34 zhenyingfang closed 8 months ago
3
lip_loss too large

#33 luqianX opened 8 months ago
1
Calculating WER using AV_hubert

#32 sharath-08 closed 8 months ago
2
paper not release quantitative results aboub TalkLip (l + g + c)

#31 keetsky opened 8 months ago
0
IndexError: list index out of range

#30 a279780399 opened 9 months ago
1
Hello, I trained a digital person with a square cover on their face. How to remove this？

#29 a279780399 opened 9 months ago
4
a

#28 a279780399 closed 9 months ago
0
hello，--word_root data how to create

#27 a279780399 opened 9 months ago
6
Average Confidence value range 1~2?

#26 9B8DY6 opened 9 months ago
1
LRS2 and LRW permission request

#25 ParaZiFal opened 9 months ago
0
[Question] How to output long sequence video demo？

#24 JSHZT opened 9 months ago
0
[BUG]The bug of the function audio_visual_pad I found

#23 JSHZT closed 9 months ago
1
Why the WER is 66% when I used your checkpoint to train the model?

#22 jtTATannn opened 10 months ago
2
Request for sharing the pre-trained discriminator weights

#21 amadeusuzx opened 10 months ago
2
Runtime error with long videos >30s

#20 crankyz closed 11 months ago
2
Does anyone have a demo video for the demonstration？

#19 cmmclee opened 1 year ago
1
Could you upload the ckpt of TalkLip_disc_qual?

#18 Ironieser opened 1 year ago
0
After executing an epoch during training, this error will appear. Has anyone encountered it?

#17 weiwenping-cn opened 1 year ago
3
Is a typo or bug?

#16 Ironieser opened 1 year ago
2
AttributeError: 'AVHubertSeq2Seq' object has no attribute 'num_updates'

#15 secnavo opened 1 year ago
1
Any body came across this error?

#14 xiaozhi2015 closed 1 year ago
1
Is there a way to reduce the use of GPU memory?

#13 zychyz95822 closed 1 year ago
2
There is a bug that is ignored in the wav data processing.

#12 Ironieser opened 1 year ago
1
checkpoint

#11 Inferencer closed 1 year ago
2
Discriminator Forward Pass

#10 nour-khalid opened 1 year ago
1
the face in output video is blurred

#9 ZardYuan opened 1 year ago
3
training script

#8 salwaalkhatib opened 1 year ago
3
the output video frames will increase unexpectly

#7 weizmann opened 1 year ago
7
IndexError: index 0 is out of bounds for dimension 0 with size 0

#6 johnny7861532 opened 1 year ago
5
how to install avhubert?

#5 Crd1140234468 closed 1 year ago
0
omegaconf.errors.ConfigKeyError: Key 'input_modality' not in 'AVHubertPretrainingConfig'

#4 Keith-Hon opened 1 year ago
3
Project Page ?

#3 francqz31 closed 5 months ago
0
High resolution video cause cuda out of memory

#2 1059692261 opened 1 year ago
5
about output file tmp.avi and tmp.mp4

#1 chikiuso closed 1 year ago
4