I am trying to setup the Audiobook maker with Tortoise as explained in Jarods latest video. I have set the an absolute result path: F:\Artificial Intelligence - AI\ai-voice-cloning-3.0\results
However I am not sure about what to select for voice_name in the yaml file. I have tried to select different ones working just fine in my tortoise TTs, they are not trained/finetuned and are just the folders with some audio clips of the characters. Does this only work with models trained/finetuned with tortoise?
Whenever I try clicking on start audio book generation I get this error in my audiobook maker cmd window:
2024-05-04 11:24:18 | INFO | rvc.configs.config | Found GPU NVIDIA GeForce RTX 3060
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
[nltk_data] Downloading package punkt to ./assets...
[nltk_data] Package punkt is already up-to-date!
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Attempt 1 failed, retrying...
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Attempt 2 failed, retrying...
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Attempt 3 failed, retrying...
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Attempt 4 failed, retrying...
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Calling API with sentence: <Hey everyone, and welcome!>
An unexpected error occurred: 'delimiter'
Attempt 5 failed, retrying...
Failed to connect after 5 attempts
F:\Artificial Intelligence - AI\audiobook_maker_v1.1\runtime\lib\site-packages\torch_utils.py:776: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
return self.fget.get(instance, owner)()
Traceback (most recent call last):
File "F:\Artificial Intelligence - AI\audiobook_maker_v1.1\audio_book_app_2_0.py", line 46, in run
self.function(self.directory_path, self.report_progress)
File "F:\Artificial Intelligence - AI\audiobook_maker_v1.1\audio_book_app_2_0.py", line 752, in generate_audio_for_sentence_threaded
audio_path = self.generate_audio(sentence)
File "F:\Artificial Intelligence - AI\audiobook_maker_v1.1\audio_book_app_2_0.py", line 796, in generate_audio
audio_path = rvc_convert(model_path=voice_model_path,
File "F:\Artificial Intelligence - AI\audiobook_maker_v1.1\runtime\lib\site-packages\rvc_pipe\rvc_infer.py", line 122, in rvcconvert
, (tgt_sr, audio_opt) = vc.vc_single(0, input_path, f0_up_key, None, f0method, file_index, file_index2, index_rate, filter_radius, resample_sr, rms_mix_rate, protect)
TypeError: cannot unpack non-iterable NoneType object
I am trying to setup the Audiobook maker with Tortoise as explained in Jarods latest video. I have set the an absolute result path: F:\Artificial Intelligence - AI\ai-voice-cloning-3.0\results
However I am not sure about what to select for voice_name in the yaml file. I have tried to select different ones working just fine in my tortoise TTs, they are not trained/finetuned and are just the folders with some audio clips of the characters. Does this only work with models trained/finetuned with tortoise?
My current yaml file looks like this:
kdelimiter : "\n" emotion : "None" custom_emotion : "" voice_name : "random" audio_file : "" voice_chunks : 0 candidates : 1 seed : 0 samples : 256 iterations : 400 temperature : .3 diffusion_sampler: "DDIM" pause_size : 8 cvvp_weight : 0 top_p : 0.76 diffusion_temp : 1 length_penalty : 6 repetition_penalty : 6 conditioning_free_k : 2 experimental_flags : ["Half Precision", "Conditioning-Free"]
Whenever I try clicking on start audio book generation I get this error in my audiobook maker cmd window:
2024-05-04 11:24:18 | INFO | rvc.configs.config | Found GPU NVIDIA GeForce RTX 3060 [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! [nltk_data] Downloading package punkt to ./assets... [nltk_data] Package punkt is already up-to-date! Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Attempt 1 failed, retrying... Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Attempt 2 failed, retrying... Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Attempt 3 failed, retrying... Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Attempt 4 failed, retrying... Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Calling API with sentence: <Hey everyone, and welcome!> An unexpected error occurred: 'delimiter' Attempt 5 failed, retrying... Failed to connect after 5 attempts F:\Artificial Intelligence - AI\audiobook_maker_v1.1\runtime\lib\site-packages\torch_utils.py:776: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() return self.fget.get(instance, owner)() Traceback (most recent call last): File "F:\Artificial Intelligence - AI\audiobook_maker_v1.1\audio_book_app_2_0.py", line 46, in run self.function(self.directory_path, self.report_progress) File "F:\Artificial Intelligence - AI\audiobook_maker_v1.1\audio_book_app_2_0.py", line 752, in generate_audio_for_sentence_threaded audio_path = self.generate_audio(sentence) File "F:\Artificial Intelligence - AI\audiobook_maker_v1.1\audio_book_app_2_0.py", line 796, in generate_audio audio_path = rvc_convert(model_path=voice_model_path, File "F:\Artificial Intelligence - AI\audiobook_maker_v1.1\runtime\lib\site-packages\rvc_pipe\rvc_infer.py", line 122, in rvcconvert , (tgt_sr, audio_opt) = vc.vc_single(0, input_path, f0_up_key, None, f0method, file_index, file_index2, index_rate, filter_radius, resample_sr, rms_mix_rate, protect) TypeError: cannot unpack non-iterable NoneType object
F:\Artificial Intelligence - AI\audiobook_maker_v1.1>pause