MontrealCorpusTools / Montreal-Forced-Aligner

Command line utility for forced alignment using Kaldi
https://montrealcorpustools.github.io/Montreal-Forced-Aligner/
MIT License
1.29k stars 242 forks source link

[BUG] #642

Closed kira-davey closed 1 year ago

kira-davey commented 1 year ago

Debugging checklist

[y] Have you updated to latest MFA version? [y] Have you tried rerunning the command with the --clean flag?

Describe the issue A clear and concise description of what the bug is.

I just updated to the latest version, because I was getting the error message below, but I'm still getting it every time I run the aligner. I've tried to change the permissions as per the log file, but have not been able to.

For Reproducing your issue Please fill out the following:

  1. Corpus structure
    • What language is the corpus in? I've tried three different languages including English.
    • How many files/speakers?
    • Are you using lab files or TextGrid files for input? TextGrid
  2. Dictionary
    • Are you using a dictionary from MFA? If so, which one?
    • If it's a custom dictionary, what is the phoneset? mfa
  3. Acoustic model
    • If you're using an acoustic model, is it one download through MFA? If so, which one? english_mfa
    • If it's a model you've trained, what data was it trained on?

Log file Please attach the log file for the run that encountered an error (by default these will be stored in ~/Documents/MFA).

2023-05-24 01:31:59.128 AEST [9295] LOG: starting PostgreSQL 15.3 on aarch64-apple-darwin20.0.0, compiled by clang version 15.0.7, 64-bit 2023-05-24 01:31:59.128 AEST [9295] LOG: listening on Unix socket "/Users/username/Documents/MFA/pg_mfa_global_socket/.s.PGSQL.5432" 2023-05-24 01:31:59.130 AEST [9300] LOG: database system was shut down at 2023-05-24 01:31:59 AEST 2023-05-24 01:31:59.131 AEST [9295] LOG: database system is ready to accept connections 2023-05-24 01:32:02.051 AEST [9295] LOG: received fast shutdown request 2023-05-24 01:32:02.051 AEST [9295] LOG: aborting any active transactions 2023-05-24 01:32:02.051 AEST [9295] LOG: background worker "logical replication launcher" (PID 9303) exited with exit code 1 2023-05-24 01:32:02.051 AEST [9298] LOG: shutting down 2023-05-24 01:32:02.051 AEST [9298] LOG: checkpoint starting: shutdown immediate 2023-05-24 01:32:02.053 AEST [9298] LOG: checkpoint complete: wrote 7 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.001 s, sync=0.001 s, total=0.002 s; sync files=6, longest=0.001 s, average=0.001 s; distance=2 kB, estimate=2 kB 2023-05-24 01:32:02.054 AEST [9295] LOG: database system is shut down 2023-05-24 01:33:37.905 AEST [9842] FATAL: data directory "/Users/username/Documents/MFA" has invalid permissions 2023-05-24 01:33:37.905 AEST [9842] DETAIL: Permissions should be u=rwx (0700) or u=rwx,g=rx (0750).

This is from the terminal:

waiting for server to start.... stopped waiting pg_ctl: could not start server Examine the log output. Traceback (most recent call last): File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/command_line/utils.py", line 416, in start_server subprocess.check_call( File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/subprocess.py", line 413, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['pg_ctl', '-D', PosixPath('/Users/username/Documents/MFA/pg_mfa_global'), '-l', PosixPath('/Users/username/Documents/MFA/pg_log_global.txt'), 'start']' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/username/opt/miniconda3/envs/aligner/bin/mfa", line 10, in sys.exit(mfa_cli()) ^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 1130, in call return self.main(*args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/rich_click/rich_group.py", line 21, in main rv = super().main(args, standalone_mode=False, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 1055, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 1654, in invoke super().invoke(ctx) File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 1404, in invoke return ctx.invoke(self.callback, ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 760, in invoke return __callback(args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/decorators.py", line 26, in new_func return f(get_current_context(), *args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/command_line/mfa.py", line 140, in mfa_cli start_server() File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/command_line/utils.py", line 428, in start_server raise DatabaseError( montreal_forced_aligner.exceptions.DatabaseError: DatabaseError: There was an error encountered starting the global MFA database server, please see /Users/username/Documents/MFA/pg_log_global.txt for more details and/or look at the logged errors above.

Desktop (please complete the following information):

Additional context I've run the aligner fine before this on the same data with the same version installed and on the same laptop.

EDIT:

I removed iCloud and that seems to have fixed the permissions issue, but now I am getting this error in the terminal:

waiting for server to start.... done server started INFO Stopping the global MFA database server...
Exception ignored in atexit callback: <bound method ExitHooks.history_save_handler of <montreal_forced_aligner.command_line.mfa.ExitHooks object at 0x14c395590>> Traceback (most recent call last): File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/command_line/mfa.py", line 98, in history_save_handler raise self.exception File "/Users/username/opt/miniconda3/envs/aligner/bin/mfa", line 10, in sys.exit(mfa_cli()) ^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 1130, in call return self.main(*args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/rich_click/rich_group.py", line 21, in main rv = super().main(args, standalone_mode=False, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 1055, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 1657, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 1404, in invoke return ctx.invoke(self.callback, ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/core.py", line 760, in invoke return __callback(args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/click/decorators.py", line 26, in new_func return f(get_current_context(), *args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/command_line/align.py", line 106, in align_corpus_cli aligner = PretrainedAligner( ^^^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/alignment/pretrained.py", line 77, in init super().init(kw) File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/transcription/transcriber.py", line 142, in init super().init(kwargs) File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/alignment/base.py", line 111, in init super().init(kwargs) File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/corpus/acoustic_corpus.py", line 1195, in init super().init(kwargs) File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/corpus/acoustic_corpus.py", line 111, in init super().init(kwargs) File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/corpus/base.py", line 115, in init super().init(kwargs) File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/abc.py", line 525, in init super().init(kwargs) File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/abc.py", line 405, in init super().init(**kwargs) File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forced_aligner/dictionary/multispeaker.py", line 95, in init self.dictionary_model = DictionaryModel( ^^^^^^^^^^^^^^^^ File "/Users/username/opt/miniconda3/envs/aligner/lib/python3.11/site-packages/montreal_forcedaligner/models.py", line 1230, in init , line = line.split(maxsplit=1) # word ^^^^^^^ ValueError: not enough values to unpack (expected 2, got 1)

and this in the log:

2023-05-24 02:30:58.833 AEST [14010] LOG: starting PostgreSQL 15.3 on aarch64-apple-darwin20.0.0, compiled by clang version 15.0.7, 64-bit 2023-05-24 02:30:58.833 AEST [14010] LOG: listening on Unix socket "/Users/username/Documents/MFA/pg_mfa_global_socket/.s.PGSQL.5432" 2023-05-24 02:30:58.839 AEST [14013] LOG: database system was shut down at 2023-05-24 02:30:58 AEST 2023-05-24 02:30:58.841 AEST [14010] LOG: database system is ready to accept connections 2023-05-24 02:30:59.860 AEST [14010] LOG: received smart shutdown request 2023-05-24 02:30:59.860 AEST [14010] LOG: background worker "logical replication launcher" (PID 14016) exited with exit code 1 2023-05-24 02:30:59.861 AEST [14011] LOG: shutting down 2023-05-24 02:30:59.861 AEST [14011] LOG: checkpoint starting: shutdown immediate 2023-05-24 02:30:59.862 AEST [14011] LOG: checkpoint complete: wrote 7 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.001 s, sync=0.001 s, total=0.002 s; sync files=6, longest=0.001 s, average=0.001 s; distance=2 kB, estimate=2 kB 2023-05-24 02:30:59.863 AEST [14010] LOG: database system is shut down 2023-05-24 02:31:12.553 AEST [14052] LOG: starting PostgreSQL 15.3 on aarch64-apple-darwin20.0.0, compiled by clang version 15.0.7, 64-bit 2023-05-24 02:31:12.555 AEST [14052] LOG: listening on Unix socket "/Users/username/Documents/MFA/pg_mfa_global_socket/.s.PGSQL.5432" 2023-05-24 02:31:12.566 AEST [14055] LOG: database system was shut down at 2023-05-24 02:30:59 AEST 2023-05-24 02:31:12.576 AEST [14052] LOG: database system is ready to accept connections 2023-05-24 02:31:13.513 AEST [14052] LOG: received smart shutdown request 2023-05-24 02:31:13.514 AEST [14052] LOG: background worker "logical replication launcher" (PID 14058) exited with exit code 1 2023-05-24 02:31:13.514 AEST [14053] LOG: shutting down 2023-05-24 02:31:13.514 AEST [14053] LOG: checkpoint starting: shutdown immediate 2023-05-24 02:31:13.515 AEST [14053] LOG: checkpoint complete: wrote 3 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.001 s, sync=0.001 s, total=0.002 s; sync files=2, longest=0.001 s, average=0.001 s; distance=0 kB, estimate=0 kB 2023-05-24 02:31:13.517 AEST [14052] LOG: database system is shut down 2023-05-24 02:31:52.721 AEST [14106] LOG: starting PostgreSQL 15.3 on aarch64-apple-darwin20.0.0, compiled by clang version 15.0.7, 64-bit 2023-05-24 02:31:52.722 AEST [14106] LOG: listening on Unix socket "/Users/username/Documents/MFA/pg_mfa_global_socket/.s.PGSQL.5432" 2023-05-24 02:31:52.727 AEST [14109] LOG: database system was shut down at 2023-05-24 02:31:13 AEST 2023-05-24 02:31:52.734 AEST [14106] LOG: database system is ready to accept connections 2023-05-24 02:31:53.451 AEST [14106] LOG: received fast shutdown request 2023-05-24 02:31:53.452 AEST [14106] LOG: aborting any active transactions 2023-05-24 02:31:53.452 AEST [14106] LOG: background worker "logical replication launcher" (PID 14112) exited with exit code 1 2023-05-24 02:31:53.452 AEST [14107] LOG: shutting down 2023-05-24 02:31:53.453 AEST [14107] LOG: checkpoint starting: shutdown immediate 2023-05-24 02:31:53.454 AEST [14107] LOG: checkpoint complete: wrote 3 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.001 s, sync=0.001 s, total=0.002 s; sync files=2, longest=0.001 s, average=0.001 s; distance=0 kB, estimate=0 kB 2023-05-24 02:31:53.455 AEST [14106] LOG: database system is shut down 2023-05-24 02:32:50.372 AEST [14157] LOG: starting PostgreSQL 15.3 on aarch64-apple-darwin20.0.0, compiled by clang version 15.0.7, 64-bit 2023-05-24 02:32:50.372 AEST [14157] LOG: listening on Unix socket "/Users/username/Documents/MFA/pg_mfa_global_socket/.s.PGSQL.5432" 2023-05-24 02:32:50.385 AEST [14160] LOG: database system was shut down at 2023-05-24 02:31:53 AEST 2023-05-24 02:32:50.391 AEST [14157] LOG: database system is ready to accept connections 2023-05-24 02:32:51.186 AEST [14157] LOG: received fast shutdown request 2023-05-24 02:32:51.186 AEST [14157] LOG: aborting any active transactions 2023-05-24 02:32:51.187 AEST [14157] LOG: background worker "logical replication launcher" (PID 14163) exited with exit code 1 2023-05-24 02:32:51.187 AEST [14158] LOG: shutting down 2023-05-24 02:32:51.187 AEST [14158] LOG: checkpoint starting: shutdown immediate 2023-05-24 02:32:51.188 AEST [14158] LOG: checkpoint complete: wrote 3 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.001 s, sync=0.001 s, total=0.002 s; sync files=2, longest=0.001 s, average=0.001 s; distance=0 kB, estimate=0 kB 2023-05-24 02:32:51.190 AEST [14157] LOG: database system is shut down 2023-05-24 02:43:30.432 AEST [14622] LOG: starting PostgreSQL 15.3 on aarch64-apple-darwin20.0.0, compiled by clang version 15.0.7, 64-bit 2023-05-24 02:43:30.433 AEST [14622] LOG: listening on Unix socket "/Users/username/Documents/MFA/pg_mfa_global_socket/.s.PGSQL.5432" 2023-05-24 02:43:30.443 AEST [14625] LOG: database system was shut down at 2023-05-24 02:32:51 AEST 2023-05-24 02:43:30.450 AEST [14622] LOG: database system is ready to accept connections 2023-05-24 02:43:31.312 AEST [14622] LOG: received fast shutdown request 2023-05-24 02:43:31.313 AEST [14622] LOG: aborting any active transactions 2023-05-24 02:43:31.313 AEST [14622] LOG: background worker "logical replication launcher" (PID 14628) exited with exit code 1 2023-05-24 02:43:31.313 AEST [14623] LOG: shutting down 2023-05-24 02:43:31.313 AEST [14623] LOG: checkpoint starting: shutdown immediate 2023-05-24 02:43:31.315 AEST [14623] LOG: checkpoint complete: wrote 3 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.001 s, sync=0.001 s, total=0.002 s; sync files=2, longest=0.001 s, average=0.001 s; distance=0 kB, estimate=0 kB 2023-05-24 02:43:31.316 AEST [14622] LOG: database system is shut down 2023-05-24 02:43:59.985 AEST [14659] LOG: starting PostgreSQL 15.3 on aarch64-apple-darwin20.0.0, compiled by clang version 15.0.7, 64-bit 2023-05-24 02:43:59.992 AEST [14659] LOG: listening on Unix socket "/Users/username/Documents/MFA/pg_mfa_global_socket/.s.PGSQL.5432" 2023-05-24 02:43:59.997 AEST [14662] LOG: database system was shut down at 2023-05-24 02:43:31 AEST 2023-05-24 02:44:00.003 AEST [14659] LOG: database system is ready to accept connections 2023-05-24 02:44:00.775 AEST [14659] LOG: received fast shutdown request 2023-05-24 02:44:00.775 AEST [14659] LOG: aborting any active transactions 2023-05-24 02:44:00.775 AEST [14659] LOG: background worker "logical replication launcher" (PID 14665) exited with exit code 1 2023-05-24 02:44:00.776 AEST [14660] LOG: shutting down 2023-05-24 02:44:00.776 AEST [14660] LOG: checkpoint starting: shutdown immediate 2023-05-24 02:44:00.777 AEST [14660] LOG: checkpoint complete: wrote 3 buffers (0.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.001 s, sync=0.001 s, total=0.002 s; sync files=2, longest=0.001 s, average=0.001 s; distance=0 kB, estimate=0 kB 2023-05-24 02:44:00.779 AEST [14659] LOG: database system is shut down