octimot / StoryToolkitAI

An editing tool that uses AI to transcribe, understand content and search for anything in your footage, integrated with ChatGPT and other AI models
GNU General Public License v3.0
710 stars 59 forks source link

Speaker Detection Keeps Failing #187

Open GypsyAcidQueen opened 3 months ago

GypsyAcidQueen commented 3 months ago

When I try to run speaker detection in v 0.24, I get this error

ERROR: Unable to execute task <bound method ToolkitOps.speaker_detection of <storytoolkitai.core.toolkit_ops.toolkit_ops.ToolkitOps object at 0x000001F43005AD70>> for queue item TranslationofLiJingQiA.wav(SpeakerDetection)-1721905998.6038613 Traceback (most recent call last): File "E:\StoryToolkitAI\StoryToolkitAI\storytoolkitai..\storytoolkitai\core\toolkit_ops\processing_queue.py", line 739, in execute_item_tasks kwargs = task({kwargs, **item}) File "E:\StoryToolkitAI\StoryToolkitAI\storytoolkitai..\storytoolkitai\core\toolkit_ops\toolkit_ops.py", line 1502, in speaker_detection for resulting_segments, speaker_embeddings in detect_speaker_changes( File "E:\StoryToolkitAI\StoryToolkitAI\storytoolkitai..\storytoolkitai\core\toolkit_ops\speaker_diarization.py", line 101, in detect_speaker_changes model = PretrainedSpeakerEmbedding("speechbrain/spkrec-ecapa-voxceleb", device=torch.device(torch_device)) File "E:\StoryToolkitAI\venv\lib\site-packages\pyannote\audio\pipelines\speaker_verification.py", line 754, in PretrainedSpeakerEmbedding return SpeechBrainPretrainedSpeakerEmbedding( File "E:\StoryToolkitAI\venv\lib\site-packages\pyannote\audio\pipelines\speakerverification.py", line 260, in init self.classifier = SpeechBrain_EncoderClassifier.from_hparams( File "E:\StoryToolkitAI\venv\lib\site-packages\speechbrain\pretrained\interfaces.py", line 467, in from_hparams hparams_local_path = fetch( File "E:\StoryToolkitAI\venv\lib\site-packages\speechbrain\pretrained\fetching.py", line 181, in fetch destination.symlink_to(sourcepath) File "C:\Users\Alex\AppData\Local\Programs\Python\Python310\lib\pathlib.py", line 1255, in symlink_to self._accessor.symlink(target, self, target_is_directory) OSError: [WinError 1314] A required privilege is not held by the client: 'C:\Users\Alex\.cache\huggingface\hub\models--speechbrain--spkrec-ecapa-voxceleb\snapshots\eac27266f68caa806381260bd44ace38b136c76a\hyperparams.yaml' -> 'C:\Users\Alex\.cache\torch\pyannote\speechbrain\hyperparams.yaml'

GypsyAcidQueen commented 3 months ago

Update: it works fine in CMD with administrator privileges

GypsyAcidQueen commented 3 months ago

Update: HOWEVER, group questions is throwing this error regardless of whether the CMD has administrator privileges or not.

ERROR: Unable to execute task <bound method ToolkitOps.group_questions of <storytoolkitai.core.toolkit_ops.toolkit_ops.ToolkitOps object at 0x00000189570B2920>> for queue item TranslationofLiJingQiA.wav(GroupQuestions)-1721907363.7646039 Traceback (most recent call last): File "E:\StoryToolkitAI\venv\lib\site-packages\transformers\utils\hub.py", line 402, in cached_file resolved_file = hf_hub_download( File "E:\StoryToolkitAI\venv\lib\site-packages\huggingface_hub\utils_deprecation.py", line 101, in inner_f return f(*args, **kwargs) File "E:\StoryToolkitAI\venv\lib\site-packages\huggingface_hub\utils_validators.py", line 106, in inner_fn validate_repo_id(arg_value) File "E:\StoryToolkitAI\venv\lib\site-packages\huggingface_hub\utils_validators.py", line 160, in validate_repo_id raise HFValidationError( huggingface_hub.errors.HFValidationError: Repo id must use alphanumeric chars or '-', '', '.', '--' and '..' are forbidden, '-' and '.' cannot start or end the name, max length is 96: ''.

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "E:\StoryToolkitAI\StoryToolkitAI\storytoolkitai..\storytoolkitai\core\toolkit_ops\processing_queue.py", line 739, in execute_item_tasks kwargs = task({kwargs, **item}) File "E:\StoryToolkitAI\StoryToolkitAI\storytoolkitai..\storytoolkitai\core\toolkit_ops\toolkit_ops.py", line 2491, in group_questions classified_question_segments = self.classify_segments( File "E:\StoryToolkitAI\StoryToolkitAI\storytoolkitai..\storytoolkitai\core\toolkit_ops\toolkit_ops.py", line 2305, in classify_segments classifier = pipeline('zero-shot-classification', File "E:\StoryToolkitAI\venv\lib\site-packages\transformers\pipelinesinit.py", line 768, in pipeline resolved_config_file = cached_file( File "E:\StoryToolkitAI\venv\lib\site-packages\transformers\utils\hub.py", line 466, in cached_file raise EnvironmentError( OSError: Incorrect path_or_model_id: ''. Please provide either the path to a local folder or the repo_id of a model on the Hub.