w-okada / voice-changer

リアルタイムボイスチェンジャー Realtime Voice Changer
Other
16.13k stars 1.75k forks source link

[ISSUE]: The audio repeats #1265

Open Ren3110 opened 3 months ago

Ren3110 commented 3 months ago

Voice Changer Version

v.1.5.3.18a

Operational System

Windows 10

GPU

NVIDIA GeForce GTX 1650

Read carefully and check the options

Model Type

RVC (I think?)

Issue Description

Every time I say anything so the application transforms it, first it says it perfectly, but then it starts repeating itself without me saying anything and it makes a strange loop

Application Screenshot

image

Logs on console

[VCClient] Access http://127.0.0.1:18888/ [VCClient] wait web server...0 http://127.0.0.1:18888/ Booting PHASE :main Booting PHASE :MMVCServerSIO [Voice Changer] VoiceChangerManager initializing... [Voice Changer] model slot is changed -1 -> 1 ................RVC [Voice Changer] [RVCr2] Creating instance VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:CPU-DML) [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... 2024-07-03 17:18:41.9353150 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:18:41.9452182 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] generate new embedder. (no embedder) 2024-07-03 17:18:42.8069186 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:18:42.8137040 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] Loading index... [Voice Changer] Index file is not found GENERATE INFERENCER<voice_changer.RVC.inferencer.OnnxRVCInferencer.OnnxRVCInferencer object at 0x000001A58CF03FD0> GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x000001A58CF6C730> GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x000001A58CF6C790> [Voice Changer] [RVC] Initializing... done [Voice Changer][RVC]: update_settings modelSlotIndex:1720019865001 [Voice Changer] VoiceChangerManager initializing... done. [Voice Changer] MMVC_Rest initializing... [Voice Changer] MMVC_Rest initializing... done. [Voice Changer] MMVC_SocketIOApp initializing... [Voice Changer] MMVC_SocketIOApp initializing... done. [VCClient] wait web server... done 200 [2024-07-03 17:18:56] connet sid : vKXgKkfZijbZLibMAAAC [2024-07-03 17:18:56] connet sid : 3lhr0QEUGG7C9zxZAAAD [Voice Changer] update configuration: modelSlotIndex 1720019938000 [Voice Changer] model slot is changed 1 -> 0 ................RVC [Voice Changer] [RVCr2] Creating instance VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:CPU-DML) Pipeline has been deleted [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... 2024-07-03 17:18:59.1110452 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:18:59.1183255 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] generate new embedder. (anyway) 2024-07-03 17:18:59.9622080 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:18:59.9696462 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] update configuration: modelSlotIndex 1720019939000 [Voice Changer] Loading index... [Voice Changer] Index file is not found [Voice Changer] model slot is changed 1 -> 0 GENERATE INFERENCER<voice_changer.RVC.inferencer.OnnxRVCInferencer.OnnxRVCInferencer object at 0x000001A56C2C49A0> ................RVC GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x000001A58CF6C760> [Voice Changer] [RVCr2] Creating instance GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x000001A58CF6C730> VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:CPU-DML) [Voice Changer] [RVC] Initializing... done Pipeline has been deleted [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... 2024-07-03 17:19:01.9507151 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:01.9580258 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] generate new embedder. (anyway) 2024-07-03 17:19:02.7875430 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:02.7946974 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] Loading index... [Voice Changer] Index file is not found GENERATE INFERENCER<voice_changer.RVC.inferencer.OnnxRVCInferencer.OnnxRVCInferencer object at 0x000001A573B326B0> [Voice Changer] update configuration: modelSlotIndex 1720019941000 GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x000001A56C2C49A0> [Voice Changer] update configuration: modelSlotIndex 1720019941000 GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x000001A5A78D2740> [Voice Changer] update configuration: modelSlotIndex 1720019941000 [Voice Changer] model slot is changed 1 -> 0 [Voice Changer] [RVC] Initializing... done [Voice Changer] update configuration: modelSlotIndex 1720019941000 [Voice Changer] model slot is changed 1 -> 0 ................RVC [Voice Changer] model slot is changed 1 -> 0 ................RVC [Voice Changer] [RVCr2] Creating instance ................RVC [Voice Changer] [RVCr2] Creating instance VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:CPU-DML) [Voice Changer] [RVCr2] Creating instance Pipeline has been deleted VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:CPU-DML) VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:CPU-DML) [Voice Changer] model slot is changed 1 -> 0 ................RVC [Voice Changer] [RVCr2] Creating instance VoiceChangerV2 Initialized (GPU_NUM(cuda):1, mps_enabled:False, onnx_device:CPU-DML) [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer][RVCr2] Initializing... [Voice Changer][RVC]: update_settings gpu:0 2024-07-03 17:19:04.5673439 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:04.5743353 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer][RVCr2] Initializing... [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer] generate new embedder. (anyway) 2024-07-03 17:19:05.5499399 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:05.5574346 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] generate new embedder. (anyway) [Voice Changer][RVCr2] Initializing... 2024-07-03 17:19:06.3439096 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:06.3516390 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. 2024-07-03 17:19:07.6506120 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:07.6575324 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. 2024-07-03 17:19:08.1758531 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:08.1838294 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] generate new embedder. (anyway) [Voice Changer] Loading index... 2024-07-03 17:19:09.8449002 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:09.8517798 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. [Voice Changer] Loading index... [Voice Changer] Loading index... [Voice Changer][RVC]: update_settings gpu:0 [Voice Changer] Index file is not found [Voice Changer][RVCr2] Initializing... [Voice Changer] Index file is not found GENERATE INFERENCER<voice_changer.RVC.inferencer.OnnxRVCInferencer.OnnxRVCInferencer object at 0x000001A5A7955300> 2024-07-03 17:19:11.9100209 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:11.9171057 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x000001A5A79E62F0> [Voice Changer] Index file is not found GENERATE INFERENCER<voice_changer.RVC.inferencer.OnnxRVCInferencer.OnnxRVCInferencer object at 0x000001A56C287400> [Voice Changer] generate new embedder. (anyway) GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x000001A5A78D0A30> 2024-07-03 17:19:12.7341849 [W:onnxruntime:, session_state.cc:1169 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf. 2024-07-03 17:19:12.7410318 [W:onnxruntime:, session_state.cc:1171 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments. GENERATE INFERENCER<voice_changer.RVC.inferencer.OnnxRVCInferencer.OnnxRVCInferencer object at 0x000001A5A797AAD0> GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x000001A5A79E5FF0> [Voice Changer] Loading index... [Voice Changer] [RVC] Initializing... done [Voice Changer] Index file is not found GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x000001A5A79E5F30> GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x000001A5A79E6560> GENERATE INFERENCER<voice_changer.RVC.inferencer.OnnxRVCInferencer.OnnxRVCInferencer object at 0x000001A56C286F80> Pipeline has been deleted GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x000001A5A79E5FC0> GENERATE EMBEDDER<voice_changer.RVC.embedder.OnnxContentvec.OnnxContentvec object at 0x000001A5A7A003D0> Pipeline has been deleted [Voice Changer] [RVC] Initializing... done GENERATE PITCH EXTRACTOR<voice_changer.RVC.pitchExtractor.RMVPEOnnxPitchExtractor.RMVPEOnnxPitchExtractor object at 0x000001A5A7A00430> [Voice Changer] [RVC] Initializing... done Pipeline has been deleted [Voice Changer] [RVC] Initializing... done [Voice Changer][RVC]: update_settings modelSlotIndex:1720019938000 [Voice Changer][RVC]: update_settings modelSlotIndex:1720019939000 [Voice Changer][RVC]: update_settings modelSlotIndex:1720019941000 [Voice Changer][RVC]: update_settings modelSlotIndex:1720019941000 [Voice Changer][RVC]: update_settings modelSlotIndex:1720019941000 [Voice Changer][RVC]: update_settings modelSlotIndex:1720019941000 [Voice Changer] update configuration: modelSlotIndex 1720019942000

Kuuko-fokkusugaru commented 3 months ago

Are you sure it is not because the mic listens to the speakers?

Ren3110 commented 3 months ago

Are you sure it is not because the mic listens to the speakers?

Is there any way for me to check that?

Kuuko-fokkusugaru commented 3 months ago

You could output into a virtual audio cable for example and then use a free software like Audacity to record the virtual audio cable input. You won't hear what you are speaking while doing so but you can play the recording to see if the output is indeed repeating in a loop.

Kuuko-fokkusugaru commented 3 months ago

You could also test recording a test speech without RVC then you can set the input of RVC into file mode, open the file, and play it with RVC so it does the conversion without using the mic.

Ren3110 commented 3 months ago

You could output into a virtual audio cable for example and then use a free software like Audacity to record the virtual audio cable input. You won't hear what you are speaking while doing so but you can play the recording to see if the output is indeed repeating in a loop.

I did this and indeed it repeated itself in the recording too