Open GamingDaveUk opened 10 months ago
Hi, sorry for not replying earlier, lots of work going on right now.
Try deleting the model in the finetune_models folder , and try again
Hi, sorry for not replying earlier, lots of work going on right now.
Try deleting the model in the finetune_models folder , and try again
NP You have a life chap, no one expects immediate replies :)
I do have bad news though.
I created a new folder and started afresh. Same issues popped up.
EDIT:
By new folder, I mean fully new, I cloned the repo into a fresh folder to rule out any issues with old files.
Hi, sorry for not replying earlier, lots of work going on right now.
Try deleting the model in the finetune_models folder , and try again
Just tried again with another fresh install as i see there was a commit 6 hours ago, but the same issues remain. Can I ask have you tried to recreate the steps I am doing on a fresh install your end?
So I load the webui, Click on train In finetune model name I write commentator I drop my audio sample ont the audio input section and wait for it to upload. I click train.
I cant see why it wouldnt work on my system if its working on yours but i have even tried installing it on a different hard drive and getting the exact same error sequence.
Hi, sorry for not replying earlier, lots of work going on right now.
Try deleting the model in the finetune_models folder , and try again
While I stand by what i said about not needing instant replies, the issue is still ongoing for 4 days now, is there a fix in the works?
Ok The issue (as explained to me on discord by MattiaHeron ) is that the samples i am using are not getting detected and processed by whisper (despite the fact the same samples were before a few updates) and so there are no samples going into the dataset and the app gives the error. Since I am using one large sample it means if it fails thats it, no training dataset. The chap sent me some test samples where he split them up manually into tracks and that worked (since if one fails there is still tons). I am going to leave this as a bug though since files that used to work now dont. but atleast now we know why its erroring and hopefully a more verbose error message could be added "No samples processed please upload better quality samples" or some such. Huge thankyou to MattiaHeron who helped problem solve the issue when I was looking for an alternative to the WebUI.
Same issue.
app.py: error: argument -h/--help: ignored explicit argument 's' Traceback (most recent call last): File "/usr/lib/python3.10/argparse.py", line 1878, in parse_known_args namespace, args = self._parse_known_args(args, namespace) File "/usr/lib/python3.10/argparse.py", line 2091, in _parse_known_args start_index = consume_optional(start_index) File "/usr/lib/python3.10/argparse.py", line 1999, in consume_optional raise ArgumentError(action, msg % explicit_arg) argparse.ArgumentError: argument -h/--help: ignored explicit argument 's'
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/content/xtts-webui/modules/train.py", line 87, in train_model speaker_xtts_path, config_path, original_xtts_checkpoint, vocab_file, exp_path, speaker_wav = train_gpt( File "/content/xtts-webui/scripts/utils/gpt_train.py", line 183, in train_gpt trainer = Trainer( File "/usr/local/lib/python3.10/dist-packages/trainer/trainer.py", line 397, in init args, coqpit_overrides = self.parse_argv(args) File "/usr/local/lib/python3.10/dist-packages/trainer/trainer.py", line 680, in parse_argv training_args, coqpit_overrides = parser.parse_known_args() File "/usr/lib/python3.10/argparse.py", line 1881, in parse_knownargs self.error(str(err)) File "/usr/lib/python3.10/argparse.py", line 2606, in error self.exit(2, ('%(prog)s: error: %(message)s\n') % args) File "/usr/lib/python3.10/argparse.py", line 2593, in exit _sys.exit(status) SystemExit: 2 Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/gradio/queueing.py", line 489, in call_prediction output = await route_utils.call_process_api( File "/usr/local/lib/python3.10/dist-packages/gradio/route_utils.py", line 232, in call_process_api output = await app.get_blocks().process_api( File "/usr/local/lib/python3.10/dist-packages/gradio/blocks.py", line 1561, in process_api result = await self.call_function( File "/usr/local/lib/python3.10/dist-packages/gradio/blocks.py", line 1179, in call_function prediction = await anyio.to_thread.run_sync( File "/usr/local/lib/python3.10/dist-packages/anyio/to_thread.py", line 33, in run_sync return await get_asynclib().run_sync_in_worker_thread( File "/usr/local/lib/python3.10/dist-packages/anyio/_backends/_asyncio.py", line 877, in run_sync_in_worker_thread return await future File "/usr/local/lib/python3.10/dist-packages/anyio/_backends/_asyncio.py", line 807, in run result = context.run(func, args) File "/usr/local/lib/python3.10/dist-packages/gradio/utils.py", line 678, in wrapper response = f(args, **kwargs) File "/content/xtts-webui/modules/train.py", line 245, in train_xtts_model shutil.copy(speaker_reference_path, reference_destination) File "/usr/lib/python3.10/shutil.py", line 417, in copy copyfile(src, dst, follow_symlinks=follow_symlinks) File "/usr/lib/python3.10/shutil.py", line 254, in copyfile with open(src, 'rb') as fsrc: FileNotFoundError: [Errno 2] No such file or directory: 'finetuned_models/base_model/ready/reference.wav'
Ok The issue (as explained to me on discord by MattiaHeron ) is that the samples i am using are not getting detected and processed by whisper (despite the fact the same samples were before a few updates) and so there are no samples going into the dataset and the app gives the error. Since I am using one large sample it means if it fails thats it, no training dataset. The chap sent me some test samples where he split them up manually into tracks and that worked (since if one fails there is still tons). I am going to leave this as a bug though since files that used to work now dont. but atleast now we know why its erroring and hopefully a more verbose error message could be added "No samples processed please upload better quality samples" or some such. Huge thankyou to MattiaHeron who helped problem solve the issue when I was looking for an alternative to the WebUI.
Thanks mate. You saved me from even more troubleshooting. Been trying to get this to work all day. Will make it a habit to split audio files into many smaller files. Something is probably still not right since GPU usage is never above 20% during training, but that will be explored another day.
Adding on to this, I loaded 4909 small files and the same issue occurred. Now, this is a fresh install on a different drive because I didn't want my SSD to be thrashed. I pre-split them with a StyleTTS2 tool as it happened to match all the boxes that XTTS needs in audio. Sadly, it did not workout and does not explain anything other than the above issues. I would hope to have seen a "no audio files" or "failed to create dataset" sort of error.
New thread as its a different issue this time.
So I load the webui, Click on train In finetune model name I write commentator I drop my audio sample ont the audio input section and wait for it to upload. I click train.
I get this error:
The folder does not exist.
If I click train again it creates the folder and proceeds and I get this error:
finetuned_models\commentator
If i place a wav file called reference.wav in the folder I can proceed to the next error.
No idea past this point.
Metadata_train.csv just includes "audio_file|text|speaker_name"
Full log including the Git pull, installer run (to make sure requirements are installed) and all the errors: