Trouble with standalone's Deepspeed Setup through atsetup.sh

[LaptopDev]

I've initiated the alltalk_tts app with start_alltalk.sh after installing alltalk with atsetup.sh and can access alltalk's WebUI, but I'm uncertain about the atsetup.sh deepspeed installation which hinges seemingly on creating a conda environment to export a env var to set my cuda path to a secondary cuda installation.

Main points:

1. CUDA Toolkit 12.4 is installed, and paths are set in .bashrc.
2. Multiple CUDA versions in /usr/local.
3. Unsure about creating a Python environment as atsetup.sh may handle it.
4. Confusion over when to set CUDA_HOME and execute start_environment.sh/conda activate alltalkenv.
5. New to conda environments, more familiar with python venv.

Questions:

• Is an environment required prior to running atsetup.sh, or is it managed by the script?
• What's the correct sequence for setting CUDA_HOME and running atsetup.sh?

Additionally,

• Deepspeed installation documentation mentions Start the alltalk_tts Python environment 'conda activate alltalkenv', but it's unclear for me whether to create a new environment or use one that pre-exists from atsetup.sh or start_environment.sh.

System: Fedora Linux Standalone alltalk_tts

How should I set my environment up and set my environment variables? Any guidance to streamline the setup process would be appreciated. Thank you.

[erew123]

Hi @LaptopDev

I've tided up the documentation so hopefully this will clear things up for you and others. In short though, when running as a standalone:

• atsetup.sh will create a custom python environment, specifically for AllTalk.
• start_environment.sh will start that environment when run from the alltalk_tts folder.
• CUDA_HOME and other such path configuration setup will vary, depending on other activities you may be performing on your system and what other applications/python environments you may have, that need specific versions of the Nvidia CUDA Development toolkit.
• Because of the above and people having lots of potential custom configurations for multiple Python environments & different Nvidia CUDA Development toolkit versions, I can only give so much information on this, its just not possible for me to cover every scenario.
• As such, the simplest way will be to set your CUDA_HOME and search paths, is set them each and every time you start the Python environment (detailed in the setup for DeepSpeed and Finetuning). However it is possible to either globally set your cuda environment for your whole system or on a per-Python environment. But again this is custom configuration and unique to each persons needs. To do permanent setups you would need to reference Conda's python instructions or Nvidia's Development Toolkit instructions, then translate them to your flavour of Linux (or Windows, for Windows users).
• If you have multiple Nvidia CUDA Development Toolkits installed, you may need to set your CUDA environment paths to specifically pick out one of them, when you set the environment variables after starting the Python environment.

Please check on:

Understanding Python Environments Simplified in the help section DeepSpeed Installation options here

Hopefully these should cover off anything else you need (as mentioned, I've updated them).

Thanks

[LaptopDev]

@erew123 Thank you for the added clarification for the deespseed installation.

I was able to print cuda version 12.1 following your update to the deepspeed standalone installation instructions and installed deepspeed after both entering the environment with 'start_environment.sh' and setting the environment variables. However, when I attempted to run ./start_alltalk.sh within the environment, I am now missing some packages, which wasn't indicated previously running start_alltalk.sh (outside of the environment?). Am I supposed to exit the environment before running ./start_alltalk.sh ?

I started installing a bunch of missing packages because I was unsure and ultimately got stuck; here is that terminal session:

``` server2:~$ cd alltalk_tts/ server2:~/alltalk_tts$ ls '=0.3.0' languages.json '=1.0.8' launch.sh '=2023.6.0' LICENSE '=4.37.1' modeldownload.json '=4.8.0' modeldownload.py alltalk_environment models atsetup.bat nvidia.Dockerfile atsetup.sh outputs confignew.json README.md Deepspeed-Windows requirements_finetune.txt diagnostics.py requirements_nvidia.txt docker-compose-cuda.yml requirements_other.txt docker-compose.yml script.py dockerconfig.json start_alltalk.sh Dockerfile start_environment.sh finetune templates finetune.py tts_server.py harvard_sentences.txt voices (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2024 NVIDIA Corporation Built on Tue_Feb_27_16:19:38_PST_2024 Cuda compilation tools, release 12.4, V12.4.99 Build cuda_12.4.r12.4/compiler.33961263_0 server2:~/alltalk_tts$ ./start_environment.sh bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ export CUDA_HOME=/usr/local/cuda-12.1 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ export PATH=${CUDA_HOME}/bin:${PATH} bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ export LD_LIBRARY_PATH=${CUDA_HOME}/lib64:$LD_LIBRARY_PATH bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2023 NVIDIA Corporation Built on Tue_Feb__7_19:32:13_PST_2023 Cuda compilation tools, release 12.1, V12.1.66 Build cuda_12.1.r12.1/compiler.32415258_0 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ pip install deepspeed Collecting deepspeed Downloading deepspeed-0.14.0.tar.gz (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 8.5 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting hjson (from deepspeed) Downloading hjson-3.1.0-py3-none-any.whl.metadata (2.6 kB) Collecting ninja (from deepspeed) Downloading ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl.metadata (5.3 kB) Requirement already satisfied: numpy in ./alltalk_environment/env/lib/python3.11/site-packages (from deepspeed) (1.24.4) Collecting packaging>=20.0 (from deepspeed) Using cached packaging-24.0-py3-none-any.whl.metadata (3.2 kB) Collecting psutil (from deepspeed) Downloading psutil-5.9.8-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (21 kB) Collecting py-cpuinfo (from deepspeed) Downloading py_cpuinfo-9.0.0-py3-none-any.whl.metadata (794 bytes) Requirement already satisfied: pydantic in ./alltalk_environment/env/lib/python3.11/site-packages (from deepspeed) (1.10.13) Collecting pynvml (from deepspeed) Downloading pynvml-11.5.0-py3-none-any.whl.metadata (7.8 kB) Requirement already satisfied: torch in ./alltalk_environment/env/lib/python3.11/site-packages (from deepspeed) (2.1.0+cu121) Collecting tqdm (from deepspeed) Downloading tqdm-4.66.2-py3-none-any.whl.metadata (57 kB) ━━━━━━━━━━━━━━━━━━━━━ 57.6/57.6 kB 3.4 MB/s eta 0:00:00 Requirement already satisfied: typing-extensions>=4.2.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from pydantic->deepspeed) (4.8.0) Requirement already satisfied: filelock in ./alltalk_environment/env/lib/python3.11/site-packages (from torch->deepspeed) (3.9.0) Requirement already satisfied: sympy in ./alltalk_environment/env/lib/python3.11/site-packages (from torch->deepspeed) (1.12) Requirement already satisfied: networkx in ./alltalk_environment/env/lib/python3.11/site-packages (from torch->deepspeed) (2.8.8) Requirement already satisfied: jinja2 in ./alltalk_environment/env/lib/python3.11/site-packages (from torch->deepspeed) (3.1.2) Requirement already satisfied: fsspec in ./alltalk_environment/env/lib/python3.11/site-packages (from torch->deepspeed) (2024.3.1) Requirement already satisfied: triton==2.1.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from torch->deepspeed) (2.1.0) Requirement already satisfied: MarkupSafe>=2.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from jinja2->torch->deepspeed) (2.1.3) Requirement already satisfied: mpmath>=0.19 in ./alltalk_environment/env/lib/python3.11/site-packages (from sympy->torch->deepspeed) (1.3.0) Using cached packaging-24.0-py3-none-any.whl (53 kB) Downloading hjson-3.1.0-py3-none-any.whl (54 kB) ━━━━━━━━━━━━━━━━━━━━━━━ 54.0/54.0 kB 3.2 MB/s eta 0:00:00 Downloading ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl (307 kB) ━━━━━━━━━━━━━━━━━━━━ 307.2/307.2 kB 19.0 MB/s eta 0:00:00 Downloading psutil-5.9.8-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (288 kB) ━━━━━━━━━━━━━━━━━━━━ 288.2/288.2 kB 17.1 MB/s eta 0:00:00 Downloading py_cpuinfo-9.0.0-py3-none-any.whl (22 kB) Downloading pynvml-11.5.0-py3-none-any.whl (53 kB) ━━━━━━━━━━━━━━━━━━━━━━━ 53.1/53.1 kB 3.1 MB/s eta 0:00:00 Downloading tqdm-4.66.2-py3-none-any.whl (78 kB) ━━━━━━━━━━━━━━━━━━━━━━━ 78.3/78.3 kB 4.9 MB/s eta 0:00:00 Building wheels for collected packages: deepspeed Building wheel for deepspeed (setup.py) ... done Created wheel for deepspeed: filename=deepspeed-0.14.0-py3-none-any.whl size=1400395 sha256=9da85f34fcf8e5a2f941136b08e016011000b7f6fede172cf67e96277debd777 Stored in directory: /home/user/.cache/pip/wheels/21/93/10/aca4f9f9390297a80a58fb8db0fcdcf1f41499d1afe922a513 Successfully built deepspeed Installing collected packages: py-cpuinfo, ninja, hjson, tqdm, pynvml, psutil, packaging, deepspeed ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. transformers 4.39.0 requires huggingface-hub<1.0,>=0.19.3, which is not installed. transformers 4.39.0 requires tokenizers<0.19,>=0.14, which is not installed. tts 0.22.0 requires aiohttp>=3.8.1, which is not installed. tts 0.22.0 requires anyascii>=0.3.0, which is not installed. tts 0.22.0 requires bangla, which is not installed. tts 0.22.0 requires bnnumerizer, which is not installed. tts 0.22.0 requires bnunicodenormalizer, which is not installed. tts 0.22.0 requires coqpit>=0.0.16, which is not installed. tts 0.22.0 requires cython>=0.29.30, which is not installed. tts 0.22.0 requires einops>=0.6.0, which is not installed. tts 0.22.0 requires encodec>=0.1.1, which is not installed. tts 0.22.0 requires flask>=2.0.1, which is not installed. tts 0.22.0 requires g2pkk>=0.1.1, which is not installed. tts 0.22.0 requires gruut[de,es,fr]==2.2.3, which is not installed. tts 0.22.0 requires hangul-romanize, which is not installed. tts 0.22.0 requires inflect>=5.6.0, which is not installed. tts 0.22.0 requires jamo, which is not installed. tts 0.22.0 requires jieba, which is not installed. tts 0.22.0 requires librosa>=0.10.0, which is not installed. tts 0.22.0 requires matplotlib>=3.7.0, which is not installed. tts 0.22.0 requires nltk, which is not installed. tts 0.22.0 requires num2words, which is not installed. tts 0.22.0 requires numba>=0.57.0; python_version >= "3.9", which is not installed. tts 0.22.0 requires pandas<2.0,>=1.4, which is not installed. tts 0.22.0 requires pypinyin, which is not installed. tts 0.22.0 requires pysbd>=0.3.4, which is not installed. tts 0.22.0 requires scikit-learn>=1.3.0, which is not installed. tts 0.22.0 requires scipy>=1.11.2, which is not installed. tts 0.22.0 requires soundfile>=0.12.0, which is not installed. tts 0.22.0 requires spacy[ja]>=3, which is not installed. tts 0.22.0 requires trainer>=0.0.32, which is not installed. tts 0.22.0 requires umap-learn>=0.5.1, which is not installed. tts 0.22.0 requires unidecode>=1.3.2, which is not installed. Successfully installed deepspeed-0.14.0 hjson-3.1.0 ninja-1.11.1.1 packaging-24.0 psutil-5.9.8 py-cpuinfo-9.0.0 pynvml-11.5.0 tqdm-4.66.2 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ./start_alltalk.sh Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 16, in import soundfile as sf ModuleNotFoundError: No module named 'soundfile' bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ exit exit server2:~/alltalk_tts$ so basically now what bash: so: command not found... server2:~/alltalk_tts$ cuda --version bash: cuda: command not found... server2:~/alltalk_tts$ nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2024 NVIDIA Corporation Built on Tue_Feb_27_16:19:38_PST_2024 Cuda compilation tools, release 12.4, V12.4.99 Build cuda_12.4.r12.4/compiler.33961263_0 server2:~/alltalk_tts$ ./start_environment.sh bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ export CUDA_HOME=/usr/local/cuda-12.1 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ export PATH=${CUDA_HOME}/bin:${PATH} bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ export LD_LIBRARY_PATH=${CUDA_HOME}/lib64:$LD_LIBRARY_PATH bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2023 NVIDIA Corporation Built on Tue_Feb__7_19:32:13_PST_2023 Cuda compilation tools, release 12.1, V12.1.66 Build cuda_12.1.r12.1/compiler.32415258_0 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ import deepspeed import: unable to open X server `' @ error/import.c/ImportImageCommand/348. bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ python Python 3.11.8 (main, Feb 26 2024, 21:39:34) [GCC 11.2.0] on linux Type "help", "copyright", "credits" or "license" for more information. >>> import deepspeed [2024-03-22 13:43:27,055] [INFO] [real_accelerator.py:191:get_accelerator] Setting ds_accelerator to cuda (auto detect) >>> print(deepspeed.__version__) 0.14.0 >>> exit Use exit() or Ctrl-D (i.e. EOF) to exit >>> exit() bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2023 NVIDIA Corporation Built on Tue_Feb__7_19:32:13_PST_2023 Cuda compilation tools, release 12.1, V12.1.66 Build cuda_12.1.r12.1/compiler.32415258_0 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ python -c "import soundfile as sf; print(sf.__version__)" Traceback (most recent call last): File "", line 1, in ModuleNotFoundError: No module named 'soundfile' bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ pip install soundfile Collecting soundfile Downloading soundfile-0.12.1-py2.py3-none-manylinux_2_31_x86_64.whl.metadata (14 kB) Requirement already satisfied: cffi>=1.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from soundfile) (1.16.0) Requirement already satisfied: pycparser in ./alltalk_environment/env/lib/python3.11/site-packages (from cffi>=1.0->soundfile) (2.21) Downloading soundfile-0.12.1-py2.py3-none-manylinux_2_31_x86_64.whl (1.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 9.2 MB/s eta 0:00:00 Installing collected packages: soundfile ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. tts 0.22.0 requires aiohttp>=3.8.1, which is not installed. tts 0.22.0 requires anyascii>=0.3.0, which is not installed. tts 0.22.0 requires bangla, which is not installed. tts 0.22.0 requires bnnumerizer, which is not installed. tts 0.22.0 requires bnunicodenormalizer, which is not installed. tts 0.22.0 requires coqpit>=0.0.16, which is not installed. tts 0.22.0 requires cython>=0.29.30, which is not installed. tts 0.22.0 requires einops>=0.6.0, which is not installed. tts 0.22.0 requires encodec>=0.1.1, which is not installed. tts 0.22.0 requires flask>=2.0.1, which is not installed. tts 0.22.0 requires g2pkk>=0.1.1, which is not installed. tts 0.22.0 requires gruut[de,es,fr]==2.2.3, which is not installed. tts 0.22.0 requires hangul-romanize, which is not installed. tts 0.22.0 requires inflect>=5.6.0, which is not installed. tts 0.22.0 requires jamo, which is not installed. tts 0.22.0 requires jieba, which is not installed. tts 0.22.0 requires librosa>=0.10.0, which is not installed. tts 0.22.0 requires matplotlib>=3.7.0, which is not installed. tts 0.22.0 requires nltk, which is not installed. tts 0.22.0 requires num2words, which is not installed. tts 0.22.0 requires numba>=0.57.0; python_version >= "3.9", which is not installed. tts 0.22.0 requires pandas<2.0,>=1.4, which is not installed. tts 0.22.0 requires pypinyin, which is not installed. tts 0.22.0 requires pysbd>=0.3.4, which is not installed. tts 0.22.0 requires scikit-learn>=1.3.0, which is not installed. tts 0.22.0 requires scipy>=1.11.2, which is not installed. tts 0.22.0 requires spacy[ja]>=3, which is not installed. tts 0.22.0 requires trainer>=0.0.32, which is not installed. tts 0.22.0 requires umap-learn>=0.5.1, which is not installed. tts 0.22.0 requires unidecode>=1.3.2, which is not installed. Successfully installed soundfile-0.12.1 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ python -c "import soundfile as sf; print(sf.__version__)" 0.12.1 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ./start_alltalk.sh Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 47, in from TTS.api import TTS File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/api.py", line 9, in from TTS.utils.audio.numpy_transforms import save_wav File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/audio/__init__.py", line 1, in from TTS.utils.audio.processor import AudioProcessor File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/audio/processor.py", line 4, in import librosa ModuleNotFoundError: No module named 'librosa' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 50, in logger.error( ^^^^^^ NameError: name 'logger' is not defined bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ now what bash: now: command not found bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ exit exit server2:~/alltalk_tts$ nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2024 NVIDIA Corporation Built on Tue_Feb_27_16:19:38_PST_2024 Cuda compilation tools, release 12.4, V12.4.99 Build cuda_12.4.r12.4/compiler.33961263_0 server2:~/alltalk_tts$ # next time I get an error I wont exit the environment and instead keep server2:~/alltalk_tts$ # installing whatever the next missing python package is until I server2:~/alltalk_tts$ # get no errors and alltalk starts up server2:~/alltalk_tts$ ./start_environment.sh bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ export CUDA_HOME=/usr/local/cuda-12.1 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ export PATH=${CUDA_HOME}/bin:${PATH} bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ export LD_LIBRARY_PATH=${CUDA_HOME}/lib64:$LD_LIBRARY_PATH bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2023 NVIDIA Corporation Built on Tue_Feb__7_19:32:13_PST_2023 Cuda compilation tools, release 12.1, V12.1.66 Build cuda_12.1.r12.1/compiler.32415258_0 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ./start_alltalk.sh Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 47, in from TTS.api import TTS File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/api.py", line 9, in from TTS.utils.audio.numpy_transforms import save_wav File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/audio/__init__.py", line 1, in from TTS.utils.audio.processor import AudioProcessor File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/audio/processor.py", line 4, in import librosa ModuleNotFoundError: No module named 'librosa' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 50, in logger.error( ^^^^^^ NameError: name 'logger' is not defined bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ pip install librosa Collecting librosa Downloading librosa-0.10.1-py3-none-any.whl.metadata (8.3 kB) Collecting audioread>=2.1.9 (from librosa) Downloading audioread-3.0.1-py3-none-any.whl.metadata (8.4 kB) Requirement already satisfied: numpy!=1.22.0,!=1.22.1,!=1.22.2,>=1.20.3 in ./alltalk_environment/env/lib/python3.11/site-packages (from librosa) (1.24.4) Collecting scipy>=1.2.0 (from librosa) Downloading scipy-1.12.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.4/60.4 kB 1.1 MB/s eta 0:00:00 Collecting scikit-learn>=0.20.0 (from librosa) Downloading scikit_learn-1.4.1.post1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) Collecting joblib>=0.14 (from librosa) Downloading joblib-1.3.2-py3-none-any.whl.metadata (5.4 kB) Requirement already satisfied: decorator>=4.3.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from librosa) (5.1.1) Collecting numba>=0.51.0 (from librosa) Downloading numba-0.59.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.7 kB) Requirement already satisfied: soundfile>=0.12.1 in ./alltalk_environment/env/lib/python3.11/site-packages (from librosa) (0.12.1) Collecting pooch>=1.0 (from librosa) Downloading pooch-1.8.1-py3-none-any.whl.metadata (9.5 kB) Collecting soxr>=0.3.2 (from librosa) Downloading soxr-0.3.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.5 kB) Requirement already satisfied: typing-extensions>=4.1.1 in ./alltalk_environment/env/lib/python3.11/site-packages (from librosa) (4.8.0) Collecting lazy-loader>=0.1 (from librosa) Downloading lazy_loader-0.3-py3-none-any.whl.metadata (4.3 kB) Collecting msgpack>=1.0 (from librosa) Downloading msgpack-1.0.8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (9.1 kB) Collecting llvmlite<0.43,>=0.42.0dev0 (from numba>=0.51.0->librosa) Downloading llvmlite-0.42.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.8 kB) Collecting platformdirs>=2.5.0 (from pooch>=1.0->librosa) Downloading platformdirs-4.2.0-py3-none-any.whl.metadata (11 kB) Requirement already satisfied: packaging>=20.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from pooch>=1.0->librosa) (24.0) Requirement already satisfied: requests>=2.19.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from pooch>=1.0->librosa) (2.31.0) Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0->librosa) Downloading threadpoolctl-3.4.0-py3-none-any.whl.metadata (13 kB) Requirement already satisfied: cffi>=1.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from soundfile>=0.12.1->librosa) (1.16.0) Requirement already satisfied: pycparser in ./alltalk_environment/env/lib/python3.11/site-packages (from cffi>=1.0->soundfile>=0.12.1->librosa) (2.21) Requirement already satisfied: charset-normalizer<4,>=2 in ./alltalk_environment/env/lib/python3.11/site-packages (from requests>=2.19.0->pooch>=1.0->librosa) (2.1.1) Requirement already satisfied: idna<4,>=2.5 in ./alltalk_environment/env/lib/python3.11/site-packages (from requests>=2.19.0->pooch>=1.0->librosa) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in ./alltalk_environment/env/lib/python3.11/site-packages (from requests>=2.19.0->pooch>=1.0->librosa) (1.26.13) Requirement already satisfied: certifi>=2017.4.17 in ./alltalk_environment/env/lib/python3.11/site-packages (from requests>=2.19.0->pooch>=1.0->librosa) (2022.12.7) Downloading librosa-0.10.1-py3-none-any.whl (253 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 253.7/253.7 kB 3.9 MB/s eta 0:00:00 Downloading audioread-3.0.1-py3-none-any.whl (23 kB) Downloading joblib-1.3.2-py3-none-any.whl (302 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 302.2/302.2 kB 14.1 MB/s eta 0:00:00 Downloading lazy_loader-0.3-py3-none-any.whl (9.1 kB) Downloading msgpack-1.0.8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (409 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 409.3/409.3 kB 20.3 MB/s eta 0:00:00 Downloading numba-0.59.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.7/3.7 MB 51.2 MB/s eta 0:00:00 Downloading pooch-1.8.1-py3-none-any.whl (62 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.0/63.0 kB 3.7 MB/s eta 0:00:00 Downloading scikit_learn-1.4.1.post1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.1/12.1 MB 76.7 MB/s eta 0:00:00 Downloading scipy-1.12.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (38.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 38.4/38.4 MB 59.3 MB/s eta 0:00:00 Downloading soxr-0.3.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 20.2 MB/s eta 0:00:00 Downloading llvmlite-0.42.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (43.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.8/43.8 MB 55.8 MB/s eta 0:00:00 Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) Downloading threadpoolctl-3.4.0-py3-none-any.whl (17 kB) Installing collected packages: threadpoolctl, soxr, scipy, platformdirs, msgpack, llvmlite, lazy-loader, joblib, audioread, scikit-learn, pooch, numba, librosa ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. tts 0.22.0 requires aiohttp>=3.8.1, which is not installed. tts 0.22.0 requires anyascii>=0.3.0, which is not installed. tts 0.22.0 requires bangla, which is not installed. tts 0.22.0 requires bnnumerizer, which is not installed. tts 0.22.0 requires bnunicodenormalizer, which is not installed. tts 0.22.0 requires coqpit>=0.0.16, which is not installed. tts 0.22.0 requires cython>=0.29.30, which is not installed. tts 0.22.0 requires einops>=0.6.0, which is not installed. tts 0.22.0 requires encodec>=0.1.1, which is not installed. tts 0.22.0 requires flask>=2.0.1, which is not installed. tts 0.22.0 requires g2pkk>=0.1.1, which is not installed. tts 0.22.0 requires gruut[de,es,fr]==2.2.3, which is not installed. tts 0.22.0 requires hangul-romanize, which is not installed. tts 0.22.0 requires inflect>=5.6.0, which is not installed. tts 0.22.0 requires jamo, which is not installed. tts 0.22.0 requires jieba, which is not installed. tts 0.22.0 requires matplotlib>=3.7.0, which is not installed. tts 0.22.0 requires nltk, which is not installed. tts 0.22.0 requires num2words, which is not installed. tts 0.22.0 requires pandas<2.0,>=1.4, which is not installed. tts 0.22.0 requires pypinyin, which is not installed. tts 0.22.0 requires pysbd>=0.3.4, which is not installed. tts 0.22.0 requires spacy[ja]>=3, which is not installed. tts 0.22.0 requires trainer>=0.0.32, which is not installed. tts 0.22.0 requires umap-learn>=0.5.1, which is not installed. tts 0.22.0 requires unidecode>=1.3.2, which is not installed. Successfully installed audioread-3.0.1 joblib-1.3.2 lazy-loader-0.3 librosa-0.10.1 llvmlite-0.42.0 msgpack-1.0.8 numba-0.59.1 platformdirs-4.2.0 pooch-1.8.1 scikit-learn-1.4.1.post1 scipy-1.12.0 soxr-0.3.7 threadpoolctl-3.4.0 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ./start_alltalk.sh Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 47, in from TTS.api import TTS File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/api.py", line 10, in from TTS.utils.manage import ModelManager File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/manage.py", line 14, in from TTS.config import load_config, read_json_with_comments File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/config/__init__.py", line 8, in from coqpit import Coqpit ModuleNotFoundError: No module named 'coqpit' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 50, in logger.error( ^^^^^^ NameError: name 'logger' is not defined bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ pip install coqpit Collecting coqpit Downloading coqpit-0.0.17-py3-none-any.whl.metadata (11 kB) Downloading coqpit-0.0.17-py3-none-any.whl (13 kB) Installing collected packages: coqpit ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. tts 0.22.0 requires aiohttp>=3.8.1, which is not installed. tts 0.22.0 requires anyascii>=0.3.0, which is not installed. tts 0.22.0 requires bangla, which is not installed. tts 0.22.0 requires bnnumerizer, which is not installed. tts 0.22.0 requires bnunicodenormalizer, which is not installed. tts 0.22.0 requires cython>=0.29.30, which is not installed. tts 0.22.0 requires einops>=0.6.0, which is not installed. tts 0.22.0 requires encodec>=0.1.1, which is not installed. tts 0.22.0 requires flask>=2.0.1, which is not installed. tts 0.22.0 requires g2pkk>=0.1.1, which is not installed. tts 0.22.0 requires gruut[de,es,fr]==2.2.3, which is not installed. tts 0.22.0 requires hangul-romanize, which is not installed. tts 0.22.0 requires inflect>=5.6.0, which is not installed. tts 0.22.0 requires jamo, which is not installed. tts 0.22.0 requires jieba, which is not installed. tts 0.22.0 requires matplotlib>=3.7.0, which is not installed. tts 0.22.0 requires nltk, which is not installed. tts 0.22.0 requires num2words, which is not installed. tts 0.22.0 requires pandas<2.0,>=1.4, which is not installed. tts 0.22.0 requires pypinyin, which is not installed. tts 0.22.0 requires pysbd>=0.3.4, which is not installed. tts 0.22.0 requires spacy[ja]>=3, which is not installed. tts 0.22.0 requires trainer>=0.0.32, which is not installed. tts 0.22.0 requires umap-learn>=0.5.1, which is not installed. tts 0.22.0 requires unidecode>=1.3.2, which is not installed. Successfully installed coqpit-0.0.17 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ./start_alltalk.sh Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 47, in from TTS.api import TTS File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/api.py", line 10, in from TTS.utils.manage import ModelManager File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/manage.py", line 14, in from TTS.config import load_config, read_json_with_comments File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/config/__init__.py", line 10, in from TTS.config.shared_configs import * File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/config/shared_configs.py", line 5, in from trainer import TrainerConfig ModuleNotFoundError: No module named 'trainer' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 50, in logger.error( ^^^^^^ NameError: name 'logger' is not defined bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ pip install trainer Collecting trainer Downloading trainer-0.0.36-py3-none-any.whl.metadata (8.1 kB) Requirement already satisfied: torch>=1.7 in ./alltalk_environment/env/lib/python3.11/site-packages (from trainer) (2.1.0+cu121) Requirement already satisfied: coqpit in ./alltalk_environment/env/lib/python3.11/site-packages (from trainer) (0.0.17) Requirement already satisfied: psutil in ./alltalk_environment/env/lib/python3.11/site-packages (from trainer) (5.9.8) Requirement already satisfied: fsspec in ./alltalk_environment/env/lib/python3.11/site-packages (from trainer) (2024.3.1) Collecting tensorboard (from trainer) Downloading tensorboard-2.16.2-py3-none-any.whl.metadata (1.6 kB) Requirement already satisfied: soundfile in ./alltalk_environment/env/lib/python3.11/site-packages (from trainer) (0.12.1) Requirement already satisfied: filelock in ./alltalk_environment/env/lib/python3.11/site-packages (from torch>=1.7->trainer) (3.9.0) Requirement already satisfied: typing-extensions in ./alltalk_environment/env/lib/python3.11/site-packages (from torch>=1.7->trainer) (4.8.0) Requirement already satisfied: sympy in ./alltalk_environment/env/lib/python3.11/site-packages (from torch>=1.7->trainer) (1.12) Requirement already satisfied: networkx in ./alltalk_environment/env/lib/python3.11/site-packages (from torch>=1.7->trainer) (2.8.8) Requirement already satisfied: jinja2 in ./alltalk_environment/env/lib/python3.11/site-packages (from torch>=1.7->trainer) (3.1.2) Requirement already satisfied: triton==2.1.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from torch>=1.7->trainer) (2.1.0) Requirement already satisfied: cffi>=1.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from soundfile->trainer) (1.16.0) Collecting absl-py>=0.4 (from tensorboard->trainer) Downloading absl_py-2.1.0-py3-none-any.whl.metadata (2.3 kB) Collecting grpcio>=1.48.2 (from tensorboard->trainer) Downloading grpcio-1.62.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB) Collecting markdown>=2.6.8 (from tensorboard->trainer) Downloading Markdown-3.6-py3-none-any.whl.metadata (7.0 kB) Requirement already satisfied: numpy>=1.12.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from tensorboard->trainer) (1.24.4) Collecting protobuf!=4.24.0,>=3.19.6 (from tensorboard->trainer) Downloading protobuf-5.26.0-cp37-abi3-manylinux2014_x86_64.whl.metadata (592 bytes) Requirement already satisfied: setuptools>=41.0.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from tensorboard->trainer) (68.2.2) Requirement already satisfied: six>1.9 in ./alltalk_environment/env/lib/python3.11/site-packages (from tensorboard->trainer) (1.16.0) Collecting tensorboard-data-server<0.8.0,>=0.7.0 (from tensorboard->trainer) Downloading tensorboard_data_server-0.7.2-py3-none-manylinux_2_31_x86_64.whl.metadata (1.1 kB) Collecting werkzeug>=1.0.1 (from tensorboard->trainer) Downloading werkzeug-3.0.1-py3-none-any.whl.metadata (4.1 kB) Requirement already satisfied: pycparser in ./alltalk_environment/env/lib/python3.11/site-packages (from cffi>=1.0->soundfile->trainer) (2.21) Requirement already satisfied: MarkupSafe>=2.1.1 in ./alltalk_environment/env/lib/python3.11/site-packages (from werkzeug>=1.0.1->tensorboard->trainer) (2.1.3) Requirement already satisfied: mpmath>=0.19 in ./alltalk_environment/env/lib/python3.11/site-packages (from sympy->torch>=1.7->trainer) (1.3.0) Downloading trainer-0.0.36-py3-none-any.whl (51 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.2/51.2 kB 1.1 MB/s eta 0:00:00 Downloading tensorboard-2.16.2-py3-none-any.whl (5.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.5/5.5 MB 41.1 MB/s eta 0:00:00 Downloading absl_py-2.1.0-py3-none-any.whl (133 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.7/133.7 kB 8.4 MB/s eta 0:00:00 Downloading grpcio-1.62.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.5/5.5 MB 63.4 MB/s eta 0:00:00 Downloading Markdown-3.6-py3-none-any.whl (105 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 105.4/105.4 kB 6.6 MB/s eta 0:00:00 Downloading protobuf-5.26.0-cp37-abi3-manylinux2014_x86_64.whl (302 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 302.8/302.8 kB 18.1 MB/s eta 0:00:00 Downloading tensorboard_data_server-0.7.2-py3-none-manylinux_2_31_x86_64.whl (6.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.6/6.6 MB 51.8 MB/s eta 0:00:00 Downloading werkzeug-3.0.1-py3-none-any.whl (226 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 226.7/226.7 kB 13.7 MB/s eta 0:00:00 Installing collected packages: werkzeug, tensorboard-data-server, protobuf, markdown, grpcio, absl-py, tensorboard, trainer ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. tts 0.22.0 requires aiohttp>=3.8.1, which is not installed. tts 0.22.0 requires anyascii>=0.3.0, which is not installed. tts 0.22.0 requires bangla, which is not installed. tts 0.22.0 requires bnnumerizer, which is not installed. tts 0.22.0 requires bnunicodenormalizer, which is not installed. tts 0.22.0 requires cython>=0.29.30, which is not installed. tts 0.22.0 requires einops>=0.6.0, which is not installed. tts 0.22.0 requires encodec>=0.1.1, which is not installed. tts 0.22.0 requires flask>=2.0.1, which is not installed. tts 0.22.0 requires g2pkk>=0.1.1, which is not installed. tts 0.22.0 requires gruut[de,es,fr]==2.2.3, which is not installed. tts 0.22.0 requires hangul-romanize, which is not installed. tts 0.22.0 requires inflect>=5.6.0, which is not installed. tts 0.22.0 requires jamo, which is not installed. tts 0.22.0 requires jieba, which is not installed. tts 0.22.0 requires matplotlib>=3.7.0, which is not installed. tts 0.22.0 requires nltk, which is not installed. tts 0.22.0 requires num2words, which is not installed. tts 0.22.0 requires pandas<2.0,>=1.4, which is not installed. tts 0.22.0 requires pypinyin, which is not installed. tts 0.22.0 requires pysbd>=0.3.4, which is not installed. tts 0.22.0 requires spacy[ja]>=3, which is not installed. tts 0.22.0 requires umap-learn>=0.5.1, which is not installed. tts 0.22.0 requires unidecode>=1.3.2, which is not installed. Successfully installed absl-py-2.1.0 grpcio-1.62.1 markdown-3.6 protobuf-5.26.0 tensorboard-2.16.2 tensorboard-data-server-0.7.2 trainer-0.0.36 werkzeug-3.0.1 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ./start_alltalk.sh Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 47, in from TTS.api import TTS File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/api.py", line 11, in from TTS.utils.synthesizer import Synthesizer File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/synthesizer.py", line 6, in import pysbd ModuleNotFoundError: No module named 'pysbd' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 50, in logger.error( ^^^^^^ NameError: name 'logger' is not defined bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ pip install pysbd Collecting pysbd Downloading pysbd-0.3.4-py3-none-any.whl.metadata (6.1 kB) Downloading pysbd-0.3.4-py3-none-any.whl (71 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71.1/71.1 kB 1.7 MB/s eta 0:00:00 Installing collected packages: pysbd ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. tts 0.22.0 requires aiohttp>=3.8.1, which is not installed. tts 0.22.0 requires anyascii>=0.3.0, which is not installed. tts 0.22.0 requires bangla, which is not installed. tts 0.22.0 requires bnnumerizer, which is not installed. tts 0.22.0 requires bnunicodenormalizer, which is not installed. tts 0.22.0 requires cython>=0.29.30, which is not installed. tts 0.22.0 requires einops>=0.6.0, which is not installed. tts 0.22.0 requires encodec>=0.1.1, which is not installed. tts 0.22.0 requires flask>=2.0.1, which is not installed. tts 0.22.0 requires g2pkk>=0.1.1, which is not installed. tts 0.22.0 requires gruut[de,es,fr]==2.2.3, which is not installed. tts 0.22.0 requires hangul-romanize, which is not installed. tts 0.22.0 requires inflect>=5.6.0, which is not installed. tts 0.22.0 requires jamo, which is not installed. tts 0.22.0 requires jieba, which is not installed. tts 0.22.0 requires matplotlib>=3.7.0, which is not installed. tts 0.22.0 requires nltk, which is not installed. tts 0.22.0 requires num2words, which is not installed. tts 0.22.0 requires pandas<2.0,>=1.4, which is not installed. tts 0.22.0 requires pypinyin, which is not installed. tts 0.22.0 requires spacy[ja]>=3, which is not installed. tts 0.22.0 requires umap-learn>=0.5.1, which is not installed. tts 0.22.0 requires unidecode>=1.3.2, which is not installed. Successfully installed pysbd-0.3.4 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ./start_alltalk.sh Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 47, in from TTS.api import TTS File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/api.py", line 11, in from TTS.utils.synthesizer import Synthesizer File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/synthesizer.py", line 11, in from TTS.tts.configs.vits_config import VitsConfig File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/configs/vits_config.py", line 5, in from TTS.tts.models.vits import VitsArgs, VitsAudioConfig File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/models/vits.py", line 22, in from TTS.tts.datasets.dataset import TTSDataset, _parse_sample File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/datasets/__init__.py", line 10, in from TTS.tts.datasets.formatters import * File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/datasets/formatters.py", line 8, in import pandas as pd ModuleNotFoundError: No module named 'pandas' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 50, in logger.error( ^^^^^^ NameError: name 'logger' is not defined bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ pip install pandas Collecting pandas Downloading pandas-2.2.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (19 kB) Requirement already satisfied: numpy<2,>=1.23.2 in ./alltalk_environment/env/lib/python3.11/site-packages (from pandas) (1.24.4) Requirement already satisfied: python-dateutil>=2.8.2 in ./alltalk_environment/env/lib/python3.11/site-packages (from pandas) (2.9.0.post0) Requirement already satisfied: pytz>=2020.1 in ./alltalk_environment/env/lib/python3.11/site-packages (from pandas) (2024.1) Collecting tzdata>=2022.7 (from pandas) Downloading tzdata-2024.1-py2.py3-none-any.whl.metadata (1.4 kB) Requirement already satisfied: six>=1.5 in ./alltalk_environment/env/lib/python3.11/site-packages (from python-dateutil>=2.8.2->pandas) (1.16.0) Downloading pandas-2.2.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (13.0 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.0/13.0 MB 73.6 MB/s eta 0:00:00 Downloading tzdata-2024.1-py2.py3-none-any.whl (345 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 345.4/345.4 kB 20.7 MB/s eta 0:00:00 Installing collected packages: tzdata, pandas ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. tts 0.22.0 requires aiohttp>=3.8.1, which is not installed. tts 0.22.0 requires anyascii>=0.3.0, which is not installed. tts 0.22.0 requires bangla, which is not installed. tts 0.22.0 requires bnnumerizer, which is not installed. tts 0.22.0 requires bnunicodenormalizer, which is not installed. tts 0.22.0 requires cython>=0.29.30, which is not installed. tts 0.22.0 requires einops>=0.6.0, which is not installed. tts 0.22.0 requires encodec>=0.1.1, which is not installed. tts 0.22.0 requires flask>=2.0.1, which is not installed. tts 0.22.0 requires g2pkk>=0.1.1, which is not installed. tts 0.22.0 requires gruut[de,es,fr]==2.2.3, which is not installed. tts 0.22.0 requires hangul-romanize, which is not installed. tts 0.22.0 requires inflect>=5.6.0, which is not installed. tts 0.22.0 requires jamo, which is not installed. tts 0.22.0 requires jieba, which is not installed. tts 0.22.0 requires matplotlib>=3.7.0, which is not installed. tts 0.22.0 requires nltk, which is not installed. tts 0.22.0 requires num2words, which is not installed. tts 0.22.0 requires pypinyin, which is not installed. tts 0.22.0 requires spacy[ja]>=3, which is not installed. tts 0.22.0 requires umap-learn>=0.5.1, which is not installed. tts 0.22.0 requires unidecode>=1.3.2, which is not installed. tts 0.22.0 requires pandas<2.0,>=1.4, but you have pandas 2.2.1 which is incompatible. Successfully installed pandas-2.2.1 tzdata-2024.1 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ./start_alltalk.sh Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 47, in from TTS.api import TTS File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/api.py", line 11, in from TTS.utils.synthesizer import Synthesizer File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/synthesizer.py", line 11, in from TTS.tts.configs.vits_config import VitsConfig File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/configs/vits_config.py", line 5, in from TTS.tts.models.vits import VitsArgs, VitsAudioConfig File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/models/vits.py", line 27, in from TTS.tts.models.base_tts import BaseTTS File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/models/base_tts.py", line 19, in from TTS.tts.utils.visual import plot_alignment, plot_spectrogram File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/utils/visual.py", line 2, in import matplotlib ModuleNotFoundError: No module named 'matplotlib' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 50, in logger.error( ^^^^^^ NameError: name 'logger' is not defined bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ pip install matplotlib Collecting matplotlib Downloading matplotlib-3.8.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB) Collecting contourpy>=1.0.1 (from matplotlib) Downloading contourpy-1.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB) Collecting cycler>=0.10 (from matplotlib) Downloading cycler-0.12.1-py3-none-any.whl.metadata (3.8 kB) Collecting fonttools>=4.22.0 (from matplotlib) Downloading fonttools-4.50.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (159 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 159.4/159.4 kB 2.1 MB/s eta 0:00:00 Collecting kiwisolver>=1.3.1 (from matplotlib) Downloading kiwisolver-1.4.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.4 kB) Requirement already satisfied: numpy<2,>=1.21 in ./alltalk_environment/env/lib/python3.11/site-packages (from matplotlib) (1.24.4) Requirement already satisfied: packaging>=20.0 in ./alltalk_environment/env/lib/python3.11/site-packages (from matplotlib) (24.0) Requirement already satisfied: pillow>=8 in ./alltalk_environment/env/lib/python3.11/site-packages (from matplotlib) (10.2.0) Collecting pyparsing>=2.3.1 (from matplotlib) Downloading pyparsing-3.1.2-py3-none-any.whl.metadata (5.1 kB) Requirement already satisfied: python-dateutil>=2.7 in ./alltalk_environment/env/lib/python3.11/site-packages (from matplotlib) (2.9.0.post0) Requirement already satisfied: six>=1.5 in ./alltalk_environment/env/lib/python3.11/site-packages (from python-dateutil>=2.7->matplotlib) (1.16.0) Downloading matplotlib-3.8.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.6/11.6 MB 61.5 MB/s eta 0:00:00 Downloading contourpy-1.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (313 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 313.4/313.4 kB 19.0 MB/s eta 0:00:00 Downloading cycler-0.12.1-py3-none-any.whl (8.3 kB) Downloading fonttools-4.50.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.9/4.9 MB 30.1 MB/s eta 0:00:00 Downloading kiwisolver-1.4.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 52.5 MB/s eta 0:00:00 Downloading pyparsing-3.1.2-py3-none-any.whl (103 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 103.2/103.2 kB 6.6 MB/s eta 0:00:00 Installing collected packages: pyparsing, kiwisolver, fonttools, cycler, contourpy, matplotlib ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. tts 0.22.0 requires aiohttp>=3.8.1, which is not installed. tts 0.22.0 requires anyascii>=0.3.0, which is not installed. tts 0.22.0 requires bangla, which is not installed. tts 0.22.0 requires bnnumerizer, which is not installed. tts 0.22.0 requires bnunicodenormalizer, which is not installed. tts 0.22.0 requires cython>=0.29.30, which is not installed. tts 0.22.0 requires einops>=0.6.0, which is not installed. tts 0.22.0 requires encodec>=0.1.1, which is not installed. tts 0.22.0 requires flask>=2.0.1, which is not installed. tts 0.22.0 requires g2pkk>=0.1.1, which is not installed. tts 0.22.0 requires gruut[de,es,fr]==2.2.3, which is not installed. tts 0.22.0 requires hangul-romanize, which is not installed. tts 0.22.0 requires inflect>=5.6.0, which is not installed. tts 0.22.0 requires jamo, which is not installed. tts 0.22.0 requires jieba, which is not installed. tts 0.22.0 requires nltk, which is not installed. tts 0.22.0 requires num2words, which is not installed. tts 0.22.0 requires pypinyin, which is not installed. tts 0.22.0 requires spacy[ja]>=3, which is not installed. tts 0.22.0 requires umap-learn>=0.5.1, which is not installed. tts 0.22.0 requires unidecode>=1.3.2, which is not installed. tts 0.22.0 requires pandas<2.0,>=1.4, but you have pandas 2.2.1 which is incompatible. Successfully installed contourpy-1.2.0 cycler-0.12.1 fonttools-4.50.0 kiwisolver-1.4.5 matplotlib-3.8.3 pyparsing-3.1.2 bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ pip install aiohttp>=3.8.1 anyascii>=0.3.0 cython>=0.29.30 einops>=0.6.0 encodec>=0.1.1 flask>=2.0.1 inflect>=5.6.0 nltk num2words pypinyin spacy[ja]>=3 umap-learn>=0.5.1 unidecode>=1.3.2 pandas<2.0 g2pkk>=0.1.1 gruut[de,es,fr]==2.2.3 bash: 2.0: No such file or directory bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ./start_alltalk.sh Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 47, in from TTS.api import TTS File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/api.py", line 11, in from TTS.utils.synthesizer import Synthesizer File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/utils/synthesizer.py", line 11, in from TTS.tts.configs.vits_config import VitsConfig File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/configs/vits_config.py", line 5, in from TTS.tts.models.vits import VitsArgs, VitsAudioConfig File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/models/vits.py", line 33, in from TTS.tts.utils.text.characters import BaseCharacters, BaseVocabulary, _characters, _pad, _phonemes, _punctuations File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/utils/text/__init__.py", line 1, in from TTS.tts.utils.text.tokenizer import TTSTokenizer File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/utils/text/tokenizer.py", line 3, in from TTS.tts.utils.text import cleaners File "/home/user/alltalk_tts/alltalk_environment/env/lib/python3.11/site-packages/TTS/tts/utils/text/cleaners.py", line 6, in from anyascii import anyascii ModuleNotFoundError: No module named 'anyascii' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/alltalk_tts/script.py", line 50, in logger.error( ^^^^^^ NameError: name 'logger' is not defined bash: set_prompt: command not found (/home/user/alltalk_tts/alltalk_environment/env) bash-5.2$ ```

Thank you for your last prompt response and helping me with this. My estimation is I should uninstall alltalk because I surely messed up the requirements, re-install and follow the deepspeed instructions, but just exit the environment before running ./start_alltalk.sh.

[erew123]

Hi @LaptopDev

There is no need to exit the environment, if its the Python environment you want to use, however, just as a point of reference, you exit a conda built environment with conda deactivate or close the terminal console and open a new one.

As for your missing packages that is very strange. I don't have Fedora nor have I tried AllTalk on it, though the Python libraries are typically universal across Windows, Mac and Linux variants, so there should be no issues there.

First off to get AllTalk working you have 2x things I would suggest. You can either start the environment ./start_environment.sh and then run pip install -r requirements_nvidia.txt (I am assuming you have an Nvidia card, I dont know) and that will refresh the installation requirements.

OR

Start ./atsetup.sh not in the environment, and select option 2 Delete AllTalk's custom Python environment and then select option 1 to rebuild the Python environment. This is pretty much the above process, but with a complete rebuild of the environment. This will require DeepSpeed installing again.

Either option would be pretty quick this time around, as the packages should already be downloaded and stored in your PIP cache. I would look in the logs for a "cant download/cant find xxxxx` package.

However, saying that, you can run ./atsetup.sh and run the diagnostics, which will give you an overview of your environment both on screen and more indepth in the diagnostics.log file it generates.

Thanks

[erew123]

Hi @LaptopDev

To fully answer the question, does AllTalk have any issues with Fedora or Red-Hat based systems, also to confirm my re-write of the instructions in the documentation, I have gone through a Fedora virtual machine installation and tested. I have taken screen grabs throughout the process and you can see all the steps here

My conclusion is that there are no issues running AllTalk on Fedora and I would suggest you follow my earlier steps and rebuild the AllTalk Python environment & check your system for any conflicting issues within your configurations.

Thanks

[LaptopDev]

@erew123 Thank you for helping me! My cause for confusion I think occurred because I was assuming requirements_nvidia.txt was installed after selecting my gpu as nvidia using the atsetup.sh program, which I corrected by using pip install -r requirements_nvidia.txt in the order you describe here and in your new Fedora installation guide. That really cleared it up with the simple graphical guide. Feels like I got special treatment 😄 , but I am sure that will aid others. Thank you for your attention.