search

yerfor / GeneFace

GeneFace: Generalized and High-Fidelity 3D Talking Face Synthesis; ICLR 2023; Official code
MIT License
2.56k stars 296 forks source link

report error at the last step of generating processed data of May #242

Open nokay1992 opened 12 months ago

nokay1992 commented 12 months ago

loading deepspeech ... loading Esperanto ... loading hubert ... loading Mel and F0 ... loading 3dmm coeff ... calculating lm3d ... loading train_val.json ... /home/nokay/GeneFace-main/data_gen/nerf/binarizer.py:136: DeprecationWarning: Starting with ImageIO v3 the behavior of this function will switch to that of iio.v3.imread. To keep the current behavior (and make this warning disappear) use import imageio.v2 as imageio or call imageio.v2.imread directly. bg_img = imageio.imread(background_img_name) Binarizing train set: 21%|███████▏ | 6073/28672 [00:00<00:00, 25948.50it/s] Traceback (most recent call last): File "/home/nokay/GeneFace-main/data_gen/nerf/binarizer.py", line 277, in binarizer.parse(hparams['video_id']) File "/home/nokay/GeneFace-main/data_gen/nerf/binarizer.py", line 267, in parse ret = load_processed_data(processed_dir) File "/home/nokay/GeneFace-main/data_gen/nerf/binarizer.py", line 186, in load_processed_data 'exp': exp_arr[idx], IndexError: index 6073 is out of bounds for axis 0 with size 6073

nokay1992 commented 12 months ago

Besides, I also tried to process a video of myselt and encontour a mistake at the last step with a different error reported. I'm a Chinese so please feel free to reply my in eithor Chinese of English, there is something wrong with my keyboard so I cannot type characters. Actually, I'm really new to Ubuntu, I download and install Ubuntu just for using GeneFace.

Thanks a lot if anyone can reply me.

Followings are reports of preprocessing my own video:

params saved [INFO] ===== finished face tracking ===== [INFO] ===== extract background image from data/processed/videos/nokay/ori_imgs ===== 100%|████████████████████████████████████████████████████████████| 1577/1577 [14:11<00:00, 1.85it/s] [INFO] ===== extracted background image ===== [INFO] ===== extract head images for data/processed/videos/nokay ===== 100%|██████████████████████████████████████████████████████████| 31540/31540 [08:57<00:00, 58.73it/s] [INFO] ===== extracted head images ===== [INFO] ===== extract torso and gt images for data/processed/videos/nokay ===== 100%|██████████████████████████████████████████████████████████| 31540/31540 [21:47<00:00, 24.12it/s] [INFO] ===== extracted torso and gt images ===== [INFO] ===== save transforms ===== [INFO] ===== finished saving transforms ===== Loading the Wav2Vec2 Processor... Ignored unknown kwarg option normalize Ignored unknown kwarg option normalize Ignored unknown kwarg option normalize Ignored unknown kwarg option normalize Loading the HuBERT Model... Hubert extracted at data/processed/videos/nokay/aud_hubert.npy Mel and F0 extracted at data/processed/videos/nokay/aud_mel_f0.npy loading the model from deep_3drecon/checkpoints/facerecon/epoch_20.pth loading video ... extracting 2D facial landmarks ...: 100%|██████████████████████| 75696/75696 [39:13<00:00, 32.16it/s] data_gen/nerf/process_data.sh：行 26: 110122 已杀死 python data_gen/nerf/extract_3dmm.py --video_id=$1 | Unknow hparams: [] Traceback (most recent call last): File "/home/nokay/GeneFace-main/data_gen/nerf/binarizer.py", line 14, in set_hparams() File "/home/nokay/GeneFace-main/utils/commons/hparams.py", line 46, in set_hparams assert os.path.exists(args.config) AssertionError