search

w-okada / voice-changer

リアルタイムボイスチェンジャー Realtime Voice Changer
Other
16.63k stars 1.81k forks source link

[ISSUE]: Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. #1408

Open Tacocat263 opened 2 days ago

Tacocat263 commented 2 days ago

Voice Changer Version

MMVCServerSIO_win_onnxgpu-cuda_v.1.5.3.18a

Operational System

win 10

GPU

gtx1660ti

Read carefully and check the options

Model Type

RVC

Issue Description

No response

Application Screenshot

No response

Logs on console

C:\Users\gamep\Desktop\voice slow\MMVCServerSIO_win_onnxgpu-cuda_v.1.5.3.18a\MMVCServerSIO_win_onnxgpu-cuda_v.1.5.3.18a\MMVCServerSIO>MMVCServerSIO.exe -p 18888 --https false --content_vec_500 pretrain/checkpoint_best_legacy_500.pt --content_vec_500_onnx pretrain/content_vec_500.onnx --content_vec_500_onnx_on true --hubert_base pretrain/hubert_base.pt --hubert_base_jp pretrain/rinna_hubert_base_jp.pt --hubert_soft pretrain/hubert/hubert-soft-0d54a1f4.pt --nsf_hifigan pretrain/nsf_hifigan/model --crepe_onnx_full pretrain/crepe_onnx_full.onnx --crepe_onnx_tiny pretrain/crepe_onnx_tiny.onnx --rmvpe pretrain/rmvpe.pt --model_dir model_dir --samples samples.json Booting PHASE :main PYTHON:3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)] Activating the Voice Changer. [Voice Changer] download sample catalog. samples_0004_t.json [Voice Changer] download sample catalog. samples_0004_o.json [Voice Changer] download sample catalog. samples_0004_d.json SlotInfo::: RVCModelSlot(slotIndex=-1, voiceChangerType='RVC', name='つくよみちゃん(onnx)', description='', credit='つくよみちゃん', termsOfUseUrl='https://huggingface.co/wok000/vcclient_model/raw/main/rvc_v2_alpha/tsukuyomi-chan/terms_of_use.txt', iconFile='tsukuyomi-chan.png', speakers={0: 'target'}, modelFile='tsukuyomi_v2_40k_e100_simple.onnx', indexFile='', defaultTune=0, defaultIndexRatio=0, defaultProtect=0.5, isONNX=True, modelType='pyTorchRVC', samplingRate=-1, f0=True, embChannels=256, embOutputLayer=9, useFinalProj=True, deprecated=False, embedder='hubert_base', sampleId='Tsukuyomi-chan_o', version='v2') SlotInfo::: RVCModelSlot(slotIndex=-1, voiceChangerType='RVC', name='あみたろ(onnx)', description='', credit='あみたろ', termsOfUseUrl='https://huggingface.co/wok000/vcclient_model/raw/main/rvc_v2_alpha/amitaro/terms_of_use.txt', iconFile='amitaro.png', speakers={0: 'target'}, modelFile='amitaro_v2_40k_e100_simple.onnx', indexFile='', defaultTune=0, defaultIndexRatio=0, defaultProtect=0.5, isONNX=True, modelType='pyTorchRVC', samplingRate=-1, f0=True, embChannels=256, embOutputLayer=9, useFinalProj=True, deprecated=False, embedder='hubert_base', sampleId='Amitaro_o', version='v2') SlotInfo::: RVCModelSlot(slotIndex=-1, voiceChangerType='RVC', name='黄琴まひろ(onnx)', description='', credit='黄琴まひろ', termsOfUseUrl='https://huggingface.co/wok000/vcclient_model/raw/main/rvc_v2_alpha/kikoto_mahiro/terms_of_use.txt', iconFile='kikoto_mahiro.png', speakers={0: 'target'}, modelFile='kikoto_mahiro_v2_40k_simple.onnx', indexFile='', defaultTune=0, defaultIndexRatio=0, defaultProtect=0.5, isONNX=True, modelType='pyTorchRVC', samplingRate=-1, f0=True, embChannels=256, embOutputLayer=9, useFinalProj=True, deprecated=False, embedder='hubert_base', sampleId='KikotoMahiro_o', version='v2') SlotInfo::: RVCModelSlot(slotIndex=-1, voiceChangerType='RVC', name='刻鳴時雨(onnx)', description='', credit='刻鳴時雨', termsOfUseUrl='https://huggingface.co/wok000/vcclient_model/raw/main/rvc_v2_alpha/tokina_shigure/terms_of_use.txt', iconFile='tokina_shigure.png', speakers={0: 'target'}, modelFile='tokina_shigure_v2_40k_e100_simple.onnx', indexFile='', defaultTune=0, defaultIndexRatio=0, defaultProtect=0.5, isONNX=True, modelType='pyTorchRVC', samplingRate=-1, f0=True, embChannels=256, embOutputLayer=9, useFinalProj=True, deprecated=False, embedder='hubert_base', sampleId='TokinaShigure_o', version='v2') [Voice Changer] Downloading model files... [Voice Changer] Generating metadata... 2024-11-29 15:41:32.8080860 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 20860, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:41:32.8091318 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 17824, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. [Voice Changer] ONNX Model: Official v2 like SlotInfo::: RVCModelSlot(slotIndex=0, voiceChangerType='RVC', name='つくよみちゃん(onnx)', description='', credit='つく よみちゃん', termsOfUseUrl='https://huggingface.co/wok000/vcclient_model/raw/main/rvc_v2_alpha/tsukuyomi-chan/terms_of_use.txt', iconFile='tsukuyomi-chan.png', speakers={'0': 'target'}, modelFile='tsukuyomi_v2_40k_e100_simple.onnx', indexFile='', defaultTune=0, defaultIndexRatio=0, defaultProtect=0.5, isONNX=True, modelType='onnxRVC', samplingRate=40000, f0=True, embChannels=768, embOutputLayer=12, useFinalProj=False, deprecated=False, embedder='hubert_base', sampleId='Tsukuyomi-chan_o', version='v2') 2024-11-29 15:41:34.5161240 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 11936, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:41:34.5177576 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 20884, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. [Voice Changer] ONNX Model: Official v2 like SlotInfo::: RVCModelSlot(slotIndex=1, voiceChangerType='RVC', name='あみたろ(onnx)', description='', credit='あみたろ', termsOfUseUrl='https://huggingface.co/wok000/vcclient_model/raw/main/rvc_v2_alpha/amitaro/terms_of_use.txt', iconFile='amitaro.png', speakers={'0': 'target'}, modelFile='amitaro_v2_40k_e100_simple.onnx', indexFile='', defaultTune=0, defaultIndexRatio=0, defaultProtect=0.5, isONNX=True, modelType='onnxRVC', samplingRate=40000, f0=True, embChannels=768, embOutputLayer=12, useFinalProj=False, deprecated=False, embedder='hubert_base', sampleId='Amitaro_o', version='v2') 2024-11-29 15:41:36.0536098 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 19900, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:41:36.0547209 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 11872, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. [Voice Changer] ONNX Model: Official v2 like SlotInfo::: RVCModelSlot(slotIndex=2, voiceChangerType='RVC', name='黄琴まひろ(onnx)', description='', credit='黄琴まひ ろ', termsOfUseUrl='https://huggingface.co/wok000/vcclient_model/raw/main/rvc_v2_alpha/kikoto_mahiro/terms_of_use.txt', iconFile='kikoto_mahiro.png', speakers={'0': 'target'}, modelFile='kikoto_mahiro_v2_40k_simple.onnx', indexFile='', defaultTune=0, defaultIndexRatio=0, defaultProtect=0.5, isONNX=True, modelType='onnxRVC', samplingRate=40000, f0=True, embChannels=768, embOutputLayer=12, useFinalProj=False, deprecated=False, embedder='hubert_base', sampleId='KikotoMahiro_o', version='v2') 2024-11-29 15:41:37.5106986 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 7408, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:41:37.5124485 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 16148, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. [Voice Changer] ONNX Model: Official v2 like SlotInfo::: RVCModelSlot(slotIndex=3, voiceChangerType='RVC', name='刻鳴時雨(onnx)', description='', credit='刻鳴時雨', termsOfUseUrl='https://huggingface.co/wok000/vcclient_model/raw/main/rvc_v2_alpha/tokina_shigure/terms_of_use.txt', iconFile='tokina_shigure.png', speakers={'0': 'target'}, modelFile='tokina_shigure_v2_40k_e100_simple.onnx', indexFile='', defaultTune=0, defaultIndexRatio=0, defaultProtect=0.5, isONNX=True, modelType='onnxRVC', samplingRate=40000, f0=True, embChannels=768, embOutputLayer=12, useFinalProj=False, deprecated=False, embedder='hubert_base', sampleId='TokinaShigure_o', version='v2') Internal_Port:18888 protocol: HTTP

Please open the following URL in your browser.
http://<IP>:<PORT>/
In many cases, it will launch when you access any of the following URLs.
http://127.0.0.1:18888/

[VCClient] Access http://127.0.0.1:18888/ [VCClient] wait web server...0 http://127.0.0.1:18888/ Booting PHASE :main Booting PHASE :MMVCServerSIO [Voice Changer] VoiceChangerManager initializing... [Voice Changer] VoiceChangerManager initializing... done. [Voice Changer] MMVC_Rest initializing... [Voice Changer] MMVC_Rest initializing... done. [Voice Changer] MMVC_SocketIOApp initializing... [Voice Changer] MMVC_SocketIOApp initializing... done. [VCClient] wait web server... done 200 [2024-11-29 15:43:29] connet sid : BjB-ThRdzb5Yng0oAAAC [2024-11-29 15:43:29] connet sid : Hy3qbC5RkqCGmsMzAAAD [Voice Changer] update configuration: gpu 0 paramDict {'voiceChangerType': 'RVC', 'slot': 4, 'isSampleMode': False, 'sampleId': None, 'files': [{'name': 'egirl.pth', 'kind': 'rvcModel', 'dir': ''}, {'name': 'added_IVF2182_Flat_nprobe_1_egirl.index', 'kind': 'rvcIndex', 'dir': ''}], 'params': {}} FILE: LoadModelParamFile(name='egirl.pth', kind='rvcModel', dir='') move to C:\Users\gamep\AppData\Local\Temp\tmp5wmcjsp1\upload_dir\egirl.pth -> model_dir\4\egirl.pth FILE: LoadModelParamFile(name='added_IVF2182_Flat_nprobe_1_egirl.index', kind='rvcIndex', dir='') move to C:\Users\gamep\AppData\Local\Temp\tmp5wmcjsp1\upload_dir\added_IVF2182_Flat_nprobe_1_egirl.index -> model_dir\4\added_IVF2182_Flat_nprobe_1_egirl.index RVC:: slotInfo.modelFile egirl.pth [Voice Changer] Official Model(pyTorch) : v2 SlotInfo::: RVCModelSlot(slotIndex=-1, voiceChangerType='RVC', name='egirl', description='', credit='', termsOfUseUrl='', iconFile='', speakers={0: 'target'}, modelFile='egirl.pth', indexFile='added_IVF2182_Flat_nprobe_1_egirl.index', defaultTune=0, defaultIndexRatio=0, defaultProtect=0.5, isONNX=False, modelType='pyTorchRVCv2', samplingRate=48000, f0=True, embChannels=768, embOutputLayer=12, useFinalProj=False, deprecated=False, embedder='hubert_base', sampleId='', version='v2') params, LoadModelParams(voiceChangerType='RVC', slot=4, isSampleMode=False, sampleId=None, files=[LoadModelParamFile(name='egirl.pth', kind='rvcModel', dir=''), LoadModelParamFile(name='added_IVF2182_Flat_nprobe_1_egirl.index', kind='rvcIndex', dir='')], params={}) [Voice Changer] update configuration: modelSlotIndex 1732913182004 [Voice Changer] model slot is changed -1 -> 4 ................RVC [Voice Changer] [RVCr2] Creating instance VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU) [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... Generated Strengths: for prev:(4096,), for cur:(4096,) [Voice Changer] Pipeline is not initialized. [Voice Changer] Waiting generate pipeline... [Voice Changer] update configuration: modelSlotIndex 1732913183004 [Voice Changer] model slot is changed -1 -> 4 ................RVC [Voice Changer] [RVCr2] Creating instance VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU) [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... [Voice Changer] update configuration: modelSlotIndex 1732913184004 [Voice Changer] model slot is changed -1 -> 4 ................RVC [Voice Changer] [RVCr2] Creating instance VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU) [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... Generated Strengths: for prev:(4096,), for cur:(4096,) [Voice Changer] Pipeline is not initialized. [Voice Changer] Waiting generate pipeline... [Voice Changer] Pipeline is not initialized. [Voice Changer] Waiting generate pipeline... gin_channels: 256 self.spk_embed_dim: 109 [Voice Changer] generate new embedder. (no embedder) 2024-11-29 15:46:25.0987713 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 17996, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:25.0996579 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 11936, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:25.5435651 [W:onnxruntime:, session_state.cc:1030 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-11-29 15:46:25.5540562 [W:onnxruntime:, session_state.cc:1032 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. 2024-11-29 15:46:25.8626440 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 12232, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:25.8631859 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 18980, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. [Voice Changer] Loading index... Try loading... model_dir\4\added_IVF2182_Flat_nprobe_1_egirl.index [Voice Changer] update configuration: modelSlotIndex 1732913185004 [Voice Changer] model slot is changed -1 -> 4 ................RVC [Voice Changer] [RVCr2] Creating instance VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU) [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... [Voice Changer] update configuration: modelSlotIndex 1732913185004 [Voice Changer] model slot is changed -1 -> 4 [Voice Changer] update configuration: modelSlotIndex 1732913185004 [Voice Changer] model slot is changed -1 -> 4 ................RVC [Voice Changer] [RVCr2] Creating instance ................RVC [Voice Changer] [RVCr2] Creating instance VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU) VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:GPU) [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... GENERATE INFERENCER<voice_changer.RVC.inferencer.RVCInferencerv2.RVCInferencerv2 object at 0x0000017D7EB7F280> GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x0000017DDBD85B10> GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x0000017DDBD85AE0> [Voice Changer] [RVC] Initializing... done Pipeline has been deleted [Voice Changer][RVC]: update_settings modelSlotIndex:1732913182004 gin_channels: 256 self.spk_embed_dim: 109 gin_channels: 256 self.spk_embed_dim: 109 gin_channels: 256 self.spk_embed_dim: 109 gin_channels: 256 self.spk_embed_dim: 109 gin_channels: 256 self.spk_embed_dim: 109 [Voice Changer] generate new embedder. (anyway) 2024-11-29 15:46:30.4740043 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 18532, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:30.4763107 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 12784, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:30.8445140 [W:onnxruntime:, session_state.cc:1030 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-11-29 15:46:30.8535082 [W:onnxruntime:, session_state.cc:1032 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. 2024-11-29 15:46:31.1071261 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 20740, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:31.1086657 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 13984, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. [Voice Changer] Loading index... Try loading... model_dir\4\added_IVF2182_Flat_nprobe_1_egirl.index [Voice Changer] generate new embedder. (anyway) 2024-11-29 15:46:31.5944700 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 14228, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:31.5948464 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 18356, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:32.0467935 [W:onnxruntime:, session_state.cc:1030 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-11-29 15:46:32.0579176 [W:onnxruntime:, session_state.cc:1032 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. 2024-11-29 15:46:32.2680186 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 20408, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:32.2696905 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 9360, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. [Voice Changer] Loading index... GENERATE INFERENCER<voice_changer.RVC.inferencer.RVCInferencerv2.RVCInferencerv2 object at 0x0000017D23636E90> GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x0000017E8CB4BD30> Try loading... model_dir\4\added_IVF2182_Flat_nprobe_1_egirl.index GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x0000017E8CB79D20> [Voice Changer] generate new embedder. (anyway) 2024-11-29 15:46:33.0167460 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 20576, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:33.0185978 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 1584, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:34.0682502 [W:onnxruntime:, session_state.cc:1030 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-11-29 15:46:34.0799024 [W:onnxruntime:, session_state.cc:1032 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] [RVC] Initializing... done 2024-11-29 15:46:34.3914804 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 21256, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:34.3914946 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 20708, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. GENERATE INFERENCER<voice_changer.RVC.inferencer.RVCInferencerv2.RVCInferencerv2 object at 0x0000017DE810E380> GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x0000017D0348FE80> [Voice Changer] Loading index... GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x0000017D0348F940> Try loading... model_dir\4\added_IVF2182_Flat_nprobe_1_egirl.index Pipeline has been deleted [Voice Changer] [RVC] Initializing... done [Voice Changer] generate new embedder. (anyway) GENERATE INFERENCER<voice_changer.RVC.inferencer.RVCInferencerv2.RVCInferencerv2 object at 0x0000017D236106A0> 2024-11-29 15:46:35.1588398 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 18952, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:35.1606458 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 20940, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x0000017E8CB4BCA0> GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x0000017E8CB4BD30> 2024-11-29 15:46:35.5508188 [W:onnxruntime:, session_state.cc:1030 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-11-29 15:46:35.5638971 [W:onnxruntime:, session_state.cc:1032 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. 2024-11-29 15:46:35.7712455 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 11484, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:35.7717515 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 9404, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. [Voice Changer] [RVC] Initializing... done [Voice Changer] Loading index... Try loading... model_dir\4\added_IVF2182_Flat_nprobe_1_egirl.index [Voice Changer][RVC]: update_settings modelSlotIndex:1732913185004 [Voice Changer][RVC]: update_settings modelSlotIndex:1732913183004 [Voice Changer] generate new embedder. (anyway) 2024-11-29 15:46:36.2880029 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 3032, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:36.2893579 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 18560, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. GENERATE INFERENCER<voice_changer.RVC.inferencer.RVCInferencerv2.RVCInferencerv2 object at 0x0000017D23610130> 2024-11-29 15:46:36.9019659 [W:onnxruntime:, session_state.cc:1030 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-11-29 15:46:36.9115851 [W:onnxruntime:, session_state.cc:1032 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x0000017DEAF652D0> 2024-11-29 15:46:37.1103339 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 1600, mask: 768, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. 2024-11-29 15:46:37.1116549 [E:onnxruntime:Default, env.cc:166 onnxruntime::anonymous-namespace'::WindowsThread::ThreadMain] SetThreadAffinityMask failed for thread: 20496, mask: 192, error code: 87, error msg: The parameter is incorrect.. Specify the number of threads explicitly so the affinity is not set. GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x0000017DEAF67940> [Voice Changer] Loading index... Try loading... model_dir\4\added_IVF2182_Flat_nprobe_1_egirl.index Pipeline has been deleted [Voice Changer] [RVC] Initializing... done [Voice Changer][RVC]: update_settings modelSlotIndex:1732913184004 Pipeline has been deleted GENERATE INFERENCER<voice_changer.RVC.inferencer.RVCInferencerv2.RVCInferencerv2 object at 0x0000017DE805C6D0> GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x0000017DF1BBBB80> GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x0000017DDBD84940> [Voice Changer][RVC]: update_settings modelSlotIndex:1732913185004 Pipeline has been deleted [Voice Changer] [RVC] Initializing... done [Voice Changer][RVC]: update_settings modelSlotIndex:1732913185004 Generated Strengths: for prev:(4096,), for cur:(4096,) [Voice Changer] warming up... generating sola buffer. [Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 228, in inference File "voice_changer\RVC\pipeline\Pipeline.py", line 257, in exec RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

[Voice Changer] VC PROCESSING EXCEPTION!!! CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. Traceback (most recent call last): File "voice_changer\VoiceChangerV2.py", line 239, in on_request File "voice_changer\RVC\RVCr2.py", line 216, in inference RuntimeError: CUDA error: unspecified launch failure CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

Tacocat263 commented 2 days ago

i have cuda 12.3