STEP 4 line 279: local variable 'x' referenced before assignment

Hecate2 commented 1 year ago

The end of output from STEP 3:

Detected language: ja
こんな便利なもの持ってたんだ
Detected language: ja
あの人はもう戦わなくていいって
Detected language: ja
今の私は 誰が何と言おうと
Downloading: "https://github.com/r9y9/open_jtalk/releases/download/v1.11.1/open_jtalk_dic_utf_8-1.11.tar.gz"
dic.tar.gz: 100% 22.6M/22.6M [00:01<00:00, 18.3MB/s]
Extracting tar file /usr/local/lib/python3.8/dist-packages/pyopenjtalk/dic.tar.gz
Building prefix dict from the default dictionary ...
DEBUG:jieba:Building prefix dict from the default dictionary ...
Dumping model to file cache /tmp/jieba.cache
DEBUG:jieba:Dumping model to file cache /tmp/jieba.cache
Loading model cost 1.172 seconds.
DEBUG:jieba:Loading model cost 1.172 seconds.
Prefix dict has been built successfully.
DEBUG:jieba:Prefix dict has been built successfully.
*** buffer overflow detected ***: terminated

The output of STEP 4:

Reusing TensorBoard on port 6006 (pid 37700), started 0:02:42 ago. (Use '!kill 37700' to kill it.)

INFO:OUTPUT_MODEL:{'train': {'log_interval': 100, 'eval_interval': 1000, 'seed': 1234, 'epochs': 10000, 'learning_rate': 0.0002, 'betas': [0.8, 0.99], 'eps': 1e-09, 'batch_size': 12, 'fp16_run': True, 'lr_decay': 0.999875, 'segment_size': 8192, 'init_lr_ratio': 1, 'warmup_epochs': 0, 'c_mel': 45, 'c_kl': 1.0}, 'data': {'training_files': 'final_annotation_train.txt', 'validation_files': 'final_annotation_val.txt', 'text_cleaners': ['cjke_cleaners2'], 'max_wav_value': 32768.0, 'sampling_rate': 22050, 'filter_length': 1024, 'hop_length': 256, 'win_length': 1024, 'n_mel_channels': 80, 'mel_fmin': 0.0, 'mel_fmax': None, 'add_blank': True, 'n_speakers': 1001, 'cleaned_text': True}, 'model': {'inter_channels': 192, 'hidden_channels': 192, 'filter_channels': 768, 'n_heads': 2, 'n_layers': 6, 'kernel_size': 3, 'p_dropout': 0.1, 'resblock': '1', 'resblock_kernel_sizes': [3, 7, 11], 'resblock_dilation_sizes': [[1, 3, 5], [1, 3, 5], [1, 3, 5]], 'upsample_rates': [8, 8, 2, 2], 'upsample_initial_channel': 512, 'upsample_kernel_sizes': [16, 16, 4, 4], 'n_layers_q': 3, 'use_spectral_norm': False, 'gin_channels': 256}, 'symbols': ['_', ',', '.', '!', '?', '-', '~', '…', 'N', 'Q', 'a', 'b', 'd', 'e', 'f', 'g', 'h', 'i', 'j', 'k', 'l', 'm', 'n', 'o', 'p', 's', 't', 'u', 'v', 'w', 'x', 'y', 'z', 'ɑ', 'æ', 'ʃ', 'ʑ', 'ç', 'ɯ', 'ɪ', 'ɔ', 'ɛ', 'ɹ', 'ð', 'ə', 'ɫ', 'ɥ', 'ɸ', 'ʊ', 'ɾ', 'ʒ', 'θ', 'β', 'ŋ', 'ɦ', '⁼', 'ʰ', '`', '^', '#', '*', '=', 'ˈ', 'ˌ', '→', '↓', '↑', ' '], 'speakers': {'特别周 Special Week (Umamusume Pretty Derby)': 0, '无声铃鹿 Silence Suzuka (Umamusume Pretty Derby)': 1, '东海帝王 Tokai Teio (Umamusume Pretty Derby)': 2, '丸善斯基 Maruzensky (Umamusume Pretty Derby)': 3, '富士奇迹 Fuji Kiseki (Umamusume Pretty Derby)': 4, '小栗帽 Oguri Cap (Umamusume Pretty Derby)': 5, '黄金船 Gold Ship (Umamusume Pretty Derby)': 6, '伏特加 Vodka (Umamusume Pretty Derby)': 7, '大和赤骥 Daiwa Scarlet (Umamusume Pretty Derby)': 8, '大树快车 Taiki Shuttle (Umamusume Pretty Derby)': 9, '草上飞 Grass Wonder (Umamusume Pretty Derby)': 10, '菱亚马逊 Hishi Amazon (Umamusume Pretty Derby)': 11, '目白麦昆 Mejiro Mcqueen (Umamusume Pretty Derby)': 12, '神鹰 El Condor Pasa (Umamusume Pretty Derby)': 13, '好歌剧 T.M. Opera O (Umamusume Pretty Derby)': 14, '成田白仁 Narita Brian (Umamusume Pretty Derby)': 15, '鲁道夫象征 Symboli Rudolf (Umamusume Pretty Derby)': 16, '气槽 Air Groove (Umamusume Pretty Derby)': 17, '爱丽数码 Agnes Digital (Umamusume Pretty Derby)': 18, '青云天空 Seiun Sky (Umamusume Pretty Derby)': 19, '玉藻十字 Tamamo Cross (Umamusume Pretty Derby)': 20, '美妙姿势 Fine Motion (Umamusume Pretty Derby)': 21, '琵琶晨光 Biwa Hayahide (Umamusume Pretty Derby)': 22, '重炮 Mayano Topgun (Umamusume Pretty Derby)': 23, '曼城茶座 Manhattan Cafe (Umamusume Pretty Derby)': 24, '美普波旁 Mihono Bourbon (Umamusume Pretty Derby)': 25, '目白雷恩 Mejiro Ryan (Umamusume Pretty Derby)': 26, '雪之美人 Yukino Bijin (Umamusume Pretty Derby)': 28, '米浴 Rice Shower (Umamusume Pretty Derby)': 29, '艾尼斯风神 Ines Fujin (Umamusume Pretty Derby)': 30, '爱丽速子 Agnes Tachyon (Umamusume Pretty Derby)': 31, '爱慕织姬 Admire Vega (Umamusume Pretty Derby)': 32, '稻荷一 Inari One (Umamusume Pretty Derby)': 33, '胜利奖券 Winning Ticket (Umamusume Pretty Derby)': 34, '空中神宫 Air Shakur (Umamusume Pretty Derby)': 35, '荣进闪耀 Eishin Flash (Umamusume Pretty Derby)': 36, '真机伶 Curren Chan (Umamusume Pretty Derby)': 37, '川上公主 Kawakami Princess (Umamusume Pretty Derby)': 38, '黄金城市 Gold City (Umamusume Pretty Derby)': 39, '樱花进王 Sakura Bakushin O (Umamusume Pretty Derby)': 40, '采珠 Seeking the Pearl (Umamusume Pretty Derby)': 41, '新光风 Shinko Windy (Umamusume Pretty Derby)': 42, '东商变革 Sweep Tosho (Umamusume Pretty Derby)': 43, '超级小溪 Super Creek (Umamusume Pretty Derby)': 44, '醒目飞鹰 Smart Falcon (Umamusume Pretty Derby)': 45, '荒漠英雄 Zenno Rob Roy (Umamusume Pretty Derby)': 46, '东瀛佐敦 Tosen Jordan (Umamusume Pretty Derby)': 47, '中山庆典 Nakayama Festa (Umamusume Pretty Derby)': 48, '成田大进 Narita Taishin (Umamusume Pretty Derby)': 49, '西野花 Nishino Flower (Umamusume Pretty Derby)': 50, '春乌拉拉 Haru Urara (Umamusume Pretty Derby)': 51, '青竹回忆 Bamboo Memory (Umamusume Pretty Derby)': 52, '待兼福来 Matikane Fukukitaru (Umamusume Pretty Derby)': 55, '名将怒涛 Meisho Doto (Umamusume Pretty Derby)': 57, '目白多伯 Mejiro Dober (Umamusume Pretty Derby)': 58, '优秀素质 Nice Nature (Umamusume Pretty Derby)': 59, '帝王光环 King Halo (Umamusume Pretty Derby)': 60, '待兼诗歌剧 Matikane Tannhauser (Umamusume Pretty Derby)': 61, '生野狄杜斯 Ikuno Dictus (Umamusume Pretty Derby)': 62, '目白善信 Mejiro Palmer (Umamusume Pretty Derby)': 63, '大拓太阳神 Daitaku Helios (Umamusume Pretty Derby)': 64, '双涡轮 Twin Turbo (Umamusume Pretty Derby)': 65, '里见光钻 Satono Diamond (Umamusume Pretty Derby)': 66, '北部玄驹 Kitasan Black (Umamusume Pretty Derby)': 67, '樱花千代王 Sakura Chiyono O (Umamusume Pretty Derby)': 68, '天狼星象征 Sirius Symboli (Umamusume Pretty Derby)': 69, '目白阿尔丹 Mejiro Ardan (Umamusume Pretty Derby)': 70, '八重无敌 Yaeno Muteki (Umamusume Pretty Derby)': 71, '鹤丸刚志 Tsurumaru Tsuyoshi (Umamusume Pretty Derby)': 72, '目白光明 Mejiro Bright (Umamusume Pretty Derby)': 73, '樱花桂冠 Sakura Laurel (Umamusume Pretty Derby)': 74, '成田路 Narita Top Road (Umamusume Pretty Derby)': 75, '也文摄辉 Yamanin Zephyr (Umamusume Pretty Derby)': 76, '真弓快车 Aston Machan (Umamusume Pretty Derby)': 80, '骏川手纲 Hayakawa Tazuna (Umamusume Pretty Derby)': 81, '小林历奇 Kopano Rickey (Umamusume Pretty Derby)': 83, '奇锐骏 Wonder Acute (Umamusume Pretty Derby)': 85, '秋川理事长 President Akikawa (Umamusume Pretty Derby)': 86, '綾地 寧々 Ayachi Nene (Sanoba Witch)': 87, '因幡 めぐる Inaba Meguru (Sanoba Witch)': 88, '椎葉 紬 Shiiba Tsumugi (Sanoba Witch)': 89, '仮屋 和奏 Kariya Wakama (Sanoba Witch)': 90, '戸隠 憧子 Togakushi Touko (Sanoba Witch)': 91, '九条裟罗 Kujou Sara (Genshin Impact)': 92, '芭芭拉 Barbara (Genshin Impact)': 93, '派蒙 Paimon (Genshin Impact)': 94, '荒泷一斗 Arataki Itto (Genshin Impact)': 96, '早柚 Sayu (Genshin Impact)': 97, '香菱 Xiangling (Genshin Impact)': 98, '神里绫华 Kamisato Ayaka (Genshin Impact)': 99, '重云 Chongyun (Genshin Impact)': 100, '流浪者 Wanderer (Genshin Impact)': 102, '优菈 Eula (Genshin Impact)': 103, '凝光 Ningguang (Genshin Impact)': 105, '钟离 Zhongli (Genshin Impact)': 106, '雷电将军 Raiden Shogun (Genshin Impact)': 107, '枫原万叶 Kaedehara Kazuha (Genshin Impact)': 108, '赛诺 Cyno (Genshin Impact)': 109, '诺艾尔 Noelle (Genshin Impact)': 112, '八重神子 Yae Miko (Genshin Impact)': 113, '凯亚 Kaeya (Genshin Impact)': 114, '魈 Xiao (Genshin Impact)': 115, '托马 Thoma (Genshin Impact)': 116, '可莉 Klee (Genshin Impact)': 117, '迪卢克 Diluc (Genshin Impact)': 120, '夜兰 Yelan (Genshin Impact)': 121, '鹿野院平藏 Shikanoin Heizou (Genshin Impact)': 123, '辛焱 Xinyan (Genshin Impact)': 124, '丽莎 Lisa (Genshin Impact)': 125, '云堇 Yun Jin (Genshin Impact)': 126, '坎蒂丝 Candace (Genshin Impact)': 127, '罗莎莉亚 Rosaria (Genshin Impact)': 128, '北斗 Beidou (Genshin Impact)': 129, '珊瑚宫心海 Sangonomiya Kokomi (Genshin Impact)': 132, '烟绯 Yanfei (Genshin Impact)': 133, '久岐忍 Kuki Shinobu (Genshin Impact)': 136, '宵宫 Yoimiya (Genshin Impact)': 139, '安柏 Amber (Genshin Impact)': 143, '迪奥娜 Diona (Genshin Impact)': 144, '班尼特 Bennett (Genshin Impact)': 146, '雷泽 Razor (Genshin Impact)': 147, '阿贝多 Albedo (Genshin Impact)': 151, '温迪 Venti (Genshin Impact)': 152, '空 Player Male (Genshin Impact)': 153, '神里绫人 Kamisato Ayato (Genshin Impact)': 154, '琴 Jean (Genshin Impact)': 155, '艾尔海森 Alhaitham (Genshin Impact)': 156, '莫娜 Mona (Genshin Impact)': 157, '妮露 Nilou (Genshin Impact)': 159, '胡桃 Hu Tao (Genshin Impact)': 160, '甘雨 Ganyu (Genshin Impact)': 161, '纳西妲 Nahida (Genshin Impact)': 162, '刻晴 Keqing (Genshin Impact)': 165, '荧 Player Female (Genshin Impact)': 169, '埃洛伊 Aloy (Genshin Impact)': 179, '柯莱 Collei (Genshin Impact)': 182, '多莉 Dori (Genshin Impact)': 184, '提纳里 Tighnari (Genshin Impact)': 186, '砂糖 Sucrose (Genshin Impact)': 188, '行秋 Xingqiu (Genshin Impact)': 190, '奥兹 Oz (Genshin Impact)': 193, '五郎 Gorou (Genshin Impact)': 198, '达达利亚 Tartalia (Genshin Impact)': 202, '七七 Qiqi (Genshin Impact)': 207, '申鹤 Shenhe (Genshin Impact)': 217, '莱依拉 Layla (Genshin Impact)': 228, '菲谢尔 Fishl (Genshin Impact)': 230, 'User': 999}, 'model_dir': '././OUTPUT_MODEL', 'max_epochs': 20}
2023-02-23 03:10:15.392600: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
DEBUG:tensorflow:Falling back to TensorFlow client; we recommended you install the Cloud TPU client directly with pip install cloud-tpu-client.
2023-02-23 03:10:16.901032: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/lib64-nvidia
2023-02-23 03:10:16.901213: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/lib64-nvidia
2023-02-23 03:10:16.901242: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
DEBUG:h5py._conv:Creating converter from 7 to 5
DEBUG:h5py._conv:Creating converter from 5 to 7
...
...
...
  0% 0/55 [00:34<?, ?it/s]
Traceback (most recent call last):
  File "finetune_speaker.py", line 320, in <module>
    main()
  File "finetune_speaker.py", line 55, in main
    mp.spawn(run, nprocs=n_gpus, args=(n_gpus, hps,))
  File "/usr/local/lib/python3.8/dist-packages/torch/multiprocessing/spawn.py", line 240, in spawn
    return start_processes(fn, args, nprocs, join, daemon, start_method='spawn')
  File "/usr/local/lib/python3.8/dist-packages/torch/multiprocessing/spawn.py", line 198, in start_processes
    while not context.join():
  File "/usr/local/lib/python3.8/dist-packages/torch/multiprocessing/spawn.py", line 160, in join
    raise ProcessRaisedException(msg, error_index, failed_process.pid)
torch.multiprocessing.spawn.ProcessRaisedException: 

-- Process 0 terminated with the following error:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/torch/multiprocessing/spawn.py", line 69, in _wrap
    fn(i, *args)
  File "/content/VITS_voice_conversion/finetune_speaker.py", line 133, in run
    train_and_evaluate(rank, epoch, hps, [net_g, net_d], [optim_g, optim_d], [scheduler_g, scheduler_d], scaler, [train_loader, eval_loader], logger, [writer, writer_eval])
  File "/content/VITS_voice_conversion/finetune_speaker.py", line 241, in train_and_evaluate
    evaluate(hps, net_g, eval_loader, writer_eval)
  File "/content/VITS_voice_conversion/finetune_speaker.py", line 279, in evaluate
    y_hat, attn, mask, *_ = generator.module.infer(x, x_lengths, speakers, max_len=1000)
UnboundLocalError: local variable 'x' referenced before assignment

Plachtaa commented 1 year ago

感谢反馈，类似你这样的bug最近收到了特别多，但是很抱歉我其实并不清楚原因。请问可以分享一下你的zip文件吗？我会尝试在我这边复现，如果能够找到原因的话会通知你

Hecate2 commented 1 year ago

非常感谢。我也想办法搞个大猛显卡Linux机debug一下上传到github好困难。完整数据集可访问 https://github.com/Hecate2/sukasuka-vocal-dataset-builder/releases/tag/0.0.anime

Plachtaa commented 1 year ago

刚刚测试了你的数据，初步鉴定为数据集过大的时候，由于不明原因，并没有生成custom_character_anno.txt这个文件，目前正在尝试修复，修复完成后会在这里通知你，感谢你的反馈！

Plachtaa commented 1 year ago

该问题现已修复，具体原因是：根据音频的不同，whisper有时候会抽风生成超长的标注，导致cleaner报错buffer overflow。现在加了一个过滤条件把长度长于100个字符的标注忽略掉，经测试已经没有问题了。

Hecate2 commented 1 year ago

月莫拜大佬！

Plachtaa / VITS-fast-fine-tuning

STEP 4 line 279: local variable 'x' referenced before assignment #15