search

MontrealCorpusTools / Montreal-Forced-Aligner

Command line utility for forced alignment using Kaldi
https://montrealcorpustools.github.io/Montreal-Forced-Aligner/
MIT License
1.26k stars 242 forks source link

[BUG] #723

Open Pydataman opened 7 months ago

Pydataman commented 7 months ago

Debugging checklist

[ ] Have you updated to latest MFA version? 3.0.0a8 [ ] Have you tried rerunning the command with the --clean flag? yes Describe the issue A clear and concise description of what the bug is. the sql server appears timeout error when train a mfa model on libritts dataset For Reproducing your issue Please fill out the following:

  1. Corpus structure
    • What language is the corpus in? english
    • How many files/speakers? 376 dirs and 375024 files
    • Are you using lab files or TextGrid files for input? use lab files
  2. Dictionary
    • Are you using a dictionary from MFA? If so, which one? no
    • If it's a custom dictionary, what is the phoneset? yes, example Z_IH1_S Z IH1 S Z_IY1 Z IY1
  3. Acoustic model
    • If you're using an acoustic model, is it one download through MFA? If so, which one? no
    • If it's a model you've trained, what data was it trained on? libritts Log file Please attach the log file for the run that encountered an error (by default these will be stored in ~/Documents/MFA). Error in atexit._run_exitfuncs: Traceback (most recent call last): File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/abc.py", line 82, in run self._run() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/corpus/multiprocessing.py", line 269, in _run dict_count = session.query(Dictionary).join(Dictionary.words).limit(1).count() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 3132, in count self._legacy_from_self(col).enable_eagerloads(False).scalar() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2825, in scalar ret = self.one() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2798, in one return self._iter().one() # type: ignore File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/orm/query.py", line 2847, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 2308, in execute return self._execute_internal( File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 2180, in _execute_internal conn = self._connection_for_bind(bind) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 2047, in _connection_for_bind return trans._connection_for_bind(engine, execution_options) File "", line 2, in _connection_for_bind File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go ret_value = fn(self, *arg, **kw) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 1143, in _connection_for_bind conn = bind.connect() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 3268, in connect return self._connection_cls(self) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 145, in init self._dbapi_connection = engine.raw_connection() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 3292, in raw_connection return self.pool.connect() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 452, in connect return _ConnectionFairy._checkout(self) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 1269, in _checkout fairy = _ConnectionRecord.checkout(pool) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 716, in checkout rec = pool._do_get() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/sqlalchemy/pool/impl.py", line 158, in _do_get raise exc.TimeoutError( sqlalchemy.exc.TimeoutError: QueuePool limit of size 10 overflow 10 reached, connection timed out, timeout 30.00 (Background on this error at: https://sqlalche.me/e/20/3o7r)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/opt/msxf/miniconda3/envs/aligner/bin/mfa", line 10, in sys.exit(mfa_cli()) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/click/core.py", line 1157, in call return self.main(args, kwargs) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/rich_click/rich_command.py", line 126, in main rv = self.invoke(ctx) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/click/core.py", line 1688, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/click/core.py", line 1434, in invoke return ctx.invoke(self.callback, ctx.params) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/click/core.py", line 783, in invoke return __callback(args, *kwargs) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/click/decorators.py", line 33, in new_func return f(get_current_context(), args, kwargs) File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/command_line/train_acoustic_model.py", line 133, in train_acoustic_model_cli trainer.train() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/acoustic_modeling/trainer.py", line 495, in train self.setup() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/acoustic_modeling/trainer.py", line 341, in setup self.load_corpus() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/corpus/acoustic_corpus.py", line 1078, in load_corpus self.normalize_text() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/corpus/base.py", line 704, in normalize_text for result in run_kaldi_function(NormalizeTextFunction, args, pbar.update): File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/utils.py", line 654, in run_kaldi_function raise v File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/utils.py", line 538, in run self.function.run() File "/opt/conda/envs/aligner/lib/python3.9/site-packages/montreal_forced_aligner/abc.py", line 86, in run raise MultiprocessingError(self.job_name, error_text) montreal_forced_aligner.exceptions.MultiprocessingError: MultiprocessingError: Desktop (please complete the following information):**

Additional context Add any other context about the problem here.