ubuntu pip install issue

[Dhyungsuk]

Thank you so much for working on and sharing a good tool. Could you help me try the code?

This is error installing requirements.txt with pip on Ubuntu. The python version I use is python3.10, is there a python version you recommend?

Full error

> pip install --use-pep517 -r requirements.txt

Collecting git+https://github.com/m-bain/whisperX.git@78dcfaab51005aa703ee21375f81ed31bc248560 (from -r requirements.txt (line 3))
  Cloning https://github.com/m-bain/whisperX.git (to revision 78dcfaab51005aa703ee21375f81ed31bc248560) to /tmp/pip-req-build-4r44dneh
  Running command git clone --filter=blob:none --quiet https://github.com/m-bain/whisperX.git /tmp/pip-req-build-4r44dneh
  Running command git rev-parse -q --verify 'sha^78dcfaab51005aa703ee21375f81ed31bc248560'
  Running command git fetch -q https://github.com/m-bain/whisperX.git 78dcfaab51005aa703ee21375f81ed31bc248560
  Running command git checkout -q 78dcfaab51005aa703ee21375f81ed31bc248560
  Resolved https://github.com/m-bain/whisperX.git to commit 78dcfaab51005aa703ee21375f81ed31bc248560
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting git+https://github.com/adefossez/demucs.git (from -r requirements.txt (line 4))
  Cloning https://github.com/adefossez/demucs.git to /tmp/pip-req-build-zcqjgpxm
  Running command git clone --filter=blob:none --quiet https://github.com/adefossez/demucs.git /tmp/pip-req-build-zcqjgpxm
  Resolved https://github.com/adefossez/demucs.git to commit 8174c5d2c259dabc69acd842fc4ba5111539d507
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting git+https://github.com/oliverguhr/deepmultilingualpunctuation.git (from -r requirements.txt (line 5))
  Cloning https://github.com/oliverguhr/deepmultilingualpunctuation.git to /tmp/pip-req-build-11ii9q8e
  Running command git clone --filter=blob:none --quiet https://github.com/oliverguhr/deepmultilingualpunctuation.git /tmp/pip-req-build-11ii9q8e
  Resolved https://github.com/oliverguhr/deepmultilingualpunctuation.git to commit 5a0dd7f4fd56687f59405aa8eba1144393d8b74b
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting git+https://github.com/MahmoudAshraf97/ctc-forced-aligner.git (from -r requirements.txt (line 6))
  Cloning https://github.com/MahmoudAshraf97/ctc-forced-aligner.git to /tmp/pip-req-build-0h27n9sa
  Running command git clone --filter=blob:none --quiet https://github.com/MahmoudAshraf97/ctc-forced-aligner.git /tmp/pip-req-build-0h27n9sa
  Resolved https://github.com/MahmoudAshraf97/ctc-forced-aligner.git to commit abd458dd879305566cd4ed0c8624c95f22e3126a
  Running command git submodule update --init --recursive -q
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting wget (from -r requirements.txt (line 1))
  Using cached wget-3.2-py3-none-any.whl
Collecting nemo_toolkit!=1.22.0,!=1.23.0 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached nemo_toolkit-1.21.0-py3-none-any.whl.metadata (15 kB)
Collecting huggingface-hub (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached huggingface_hub-0.23.4-py3-none-any.whl.metadata (12 kB)
Collecting numba (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached numba-0.60.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.7 kB)
Collecting numpy<1.24,>=1.22 (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached numpy-1.23.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.3 kB)
Collecting onnx>=1.7.0 (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached onnx-1.16.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (16 kB)
Requirement already satisfied: python-dateutil in /usr/lib/python3/dist-packages (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2)) (2.7.3)
Collecting ruamel.yaml (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached ruamel.yaml-0.18.6-py3-none-any.whl.metadata (23 kB)
Collecting scikit-learn (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached scikit_learn-1.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB)
Requirement already satisfied: setuptools>=65.5.1 in /usr/local/lib/python3.10/dist-packages (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2)) (70.2.0)
Collecting tensorboard (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached tensorboard-2.17.0-py3-none-any.whl.metadata (1.6 kB)
Collecting text-unidecode (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached text_unidecode-1.3-py2.py3-none-any.whl.metadata (2.4 kB)
Collecting torch (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached torch-2.3.1-cp310-cp310-manylinux1_x86_64.whl.metadata (26 kB)
Collecting tqdm>=4.41.0 (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached tqdm-4.66.4-py3-none-any.whl.metadata (57 kB)
Collecting wrapt (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached wrapt-1.16.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB)
Collecting torchaudio>=2 (from whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached torchaudio-2.3.1-cp310-cp310-manylinux1_x86_64.whl.metadata (6.4 kB)
Collecting faster-whisper==1.0.0 (from whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached faster_whisper-1.0.0-py3-none-any.whl.metadata (14 kB)
Collecting transformers (from whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached transformers-4.42.3-py3-none-any.whl.metadata (43 kB)
Collecting pandas (from whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached pandas-2.2.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (19 kB)
Collecting nltk (from whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached nltk-3.8.1-py3-none-any.whl.metadata (2.8 kB)
Collecting pyannote.audio==3.1.1 (from whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached pyannote.audio-3.1.1-py2.py3-none-any.whl.metadata (9.3 kB)
Collecting av==11.* (from faster-whisper==1.0.0->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached av-11.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.5 kB)
Collecting ctranslate2<5,>=4.0 (from faster-whisper==1.0.0->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached ctranslate2-4.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (10 kB)
Collecting tokenizers<0.16,>=0.13 (from faster-whisper==1.0.0->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached tokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
Collecting onnxruntime<2,>=1.14 (from faster-whisper==1.0.0->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached onnxruntime-1.18.1-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (4.3 kB)
Collecting asteroid-filterbanks>=0.4 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached asteroid_filterbanks-0.4.0-py3-none-any.whl.metadata (3.3 kB)
Collecting einops>=0.6.0 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached einops-0.8.0-py3-none-any.whl.metadata (12 kB)
Collecting lightning>=2.0.1 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached lightning-2.3.1-py3-none-any.whl.metadata (54 kB)
Collecting omegaconf<3.0,>=2.1 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached omegaconf-2.3.0-py3-none-any.whl.metadata (3.9 kB)
Collecting pyannote.core>=5.0.0 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached pyannote.core-5.0.0-py3-none-any.whl.metadata (1.4 kB)
Collecting pyannote.database>=5.0.1 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached pyannote.database-5.1.0-py3-none-any.whl.metadata (1.2 kB)
Collecting pyannote.metrics>=3.2 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached pyannote.metrics-3.2.1-py3-none-any.whl.metadata (1.3 kB)
Collecting pyannote.pipeline>=3.0.1 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached pyannote.pipeline-3.0.1-py3-none-any.whl.metadata (897 bytes)
Collecting pytorch-metric-learning>=2.1.0 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached pytorch_metric_learning-2.5.0-py3-none-any.whl.metadata (17 kB)
Collecting rich>=12.0.0 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached rich-13.7.1-py3-none-any.whl.metadata (18 kB)
Collecting semver>=3.0.0 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached semver-3.0.2-py3-none-any.whl.metadata (5.0 kB)
Collecting soundfile>=0.12.1 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached soundfile-0.12.1-py2.py3-none-manylinux_2_31_x86_64.whl.metadata (14 kB)
Collecting speechbrain>=0.5.14 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached speechbrain-1.0.0-py3-none-any.whl.metadata (23 kB)
Collecting tensorboardX>=2.6 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached tensorboardX-2.6.2.2-py2.py3-none-any.whl.metadata (5.8 kB)
Collecting torch-audiomentations>=0.11.0 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached torch_audiomentations-0.11.1-py3-none-any.whl.metadata (14 kB)
Collecting torchmetrics>=0.11.0 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached torchmetrics-1.4.0.post0-py3-none-any.whl.metadata (19 kB)
Collecting dora-search (from demucs==4.1.0a3->-r requirements.txt (line 4))
  Using cached dora_search-0.1.12-py3-none-any.whl
Collecting julius>=0.2.3 (from demucs==4.1.0a3->-r requirements.txt (line 4))
  Using cached julius-0.2.7-py3-none-any.whl
Collecting lameenc>=1.2 (from demucs==4.1.0a3->-r requirements.txt (line 4))
  Using cached lameenc-1.7.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_28_x86_64.whl.metadata (803 bytes)
Collecting openunmix (from demucs==4.1.0a3->-r requirements.txt (line 4))
  Using cached openunmix-1.3.0-py3-none-any.whl.metadata (17 kB)
Requirement already satisfied: pyyaml in /usr/lib/python3/dist-packages (from demucs==4.1.0a3->-r requirements.txt (line 4)) (5.3.1)
Collecting torchaudio>=2 (from whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached torchaudio-2.1.2-cp310-cp310-manylinux1_x86_64.whl.metadata (6.4 kB)
Collecting Unidecode (from ctc-forced-aligner==0.2->-r requirements.txt (line 6))
  Using cached Unidecode-1.3.8-py3-none-any.whl.metadata (13 kB)
Collecting braceexpand (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached braceexpand-0.1.7-py2.py3-none-any.whl.metadata (3.0 kB)
Collecting editdistance (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached editdistance-0.8.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.9 kB)
Collecting g2p-en (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached g2p_en-2.1.0-py3-none-any.whl.metadata (4.5 kB)
Collecting ipywidgets (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached ipywidgets-8.1.3-py3-none-any.whl.metadata (2.4 kB)
Collecting jiwer (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached jiwer-3.0.4-py3-none-any.whl.metadata (2.6 kB)
Collecting kaldi-python-io (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached kaldi_python_io-1.2.2-py3-none-any.whl
Collecting kaldiio (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached kaldiio-2.18.0-py3-none-any.whl.metadata (13 kB)
Collecting librosa>=0.9.0 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached librosa-0.10.2.post1-py3-none-any.whl.metadata (8.6 kB)
Collecting marshmallow (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached marshmallow-3.21.3-py3-none-any.whl.metadata (7.1 kB)
Collecting matplotlib (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached matplotlib-3.9.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Collecting packaging (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached packaging-24.1-py3-none-any.whl.metadata (3.2 kB)
Collecting pydub (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached pydub-0.25.1-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting scipy>=0.14 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached scipy-1.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
Collecting sox (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached sox-1.5.0-py3-none-any.whl
Collecting texterrors (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached texterrors-0.5.1.tar.gz (23 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
Collecting hydra-core<=1.3.2,>1.3 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached hydra_core-1.3.2-py3-none-any.whl.metadata (5.5 kB)
Collecting pytorch-lightning<=2.0.7,>=2.0 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached pytorch_lightning-2.0.7-py3-none-any.whl.metadata (23 kB)
INFO: pip is looking at multiple versions of nemo-toolkit[asr] to determine which version is compatible with other requirements. This could take a while.
Collecting nemo_toolkit[asr]!=1.22.0,!=1.23.0 (from -r requirements.txt (line 2))
  Using cached nemo_toolkit-1.20.0-py3-none-any.whl.metadata (14 kB)
Collecting setuptools>=65.5.1 (from nemo_toolkit!=1.22.0,!=1.23.0->nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached setuptools-65.5.1-py3-none-any.whl.metadata (6.3 kB)
Collecting hydra-core<1.3,>=1.2.0 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached hydra_core-1.2.0-py3-none-any.whl.metadata (4.0 kB)
Collecting omegaconf<3.0,>=2.1 (from pyannote.audio==3.1.1->whisperx==3.1.1->-r requirements.txt (line 3))
  Using cached omegaconf-2.2.3-py3-none-any.whl.metadata (3.9 kB)
Collecting pytorch-lightning<=1.9.4,>=1.9.0 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached pytorch_lightning-1.9.4-py3-none-any.whl.metadata (22 kB)
Collecting wandb (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached wandb-0.17.4-py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (10 kB)
Collecting webdataset<=0.1.62,>=0.1.48 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached webdataset-0.1.62-py3-none-any.whl.metadata (5.7 kB)
Collecting inflect (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached inflect-7.3.1-py3-none-any.whl.metadata (21 kB)
Collecting pydantic<2 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached pydantic-1.10.17-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (151 kB)
Collecting sacremoses>=0.0.43 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached sacremoses-0.1.1-py3-none-any.whl.metadata (8.3 kB)
Collecting sentencepiece<1.0.0 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached sentencepiece-0.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.7 kB)
Collecting youtokentome>=1.0.5 (from nemo_toolkit[asr]!=1.22.0,!=1.23.0->-r requirements.txt (line 2))
  Using cached youtokentome-1.0.6.tar.gz (86 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [17 lines of output]
      Traceback (most recent call last):
        File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
        File "/tmp/pip-build-env-w4io6cao/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 327, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
        File "/tmp/pip-build-env-w4io6cao/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 297, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-w4io6cao/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 497, in run_setup
          super().run_setup(setup_script=setup_script)
        File "/tmp/pip-build-env-w4io6cao/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 313, in run_setup
          exec(code, locals())
        File "<string>", line 5, in <module>
      ModuleNotFoundError: No module named 'Cython'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

[transcriptionstream]

Try

apt install cython3

first

[Dhyungsuk]

Thank you for your help. I didn't read README properly. Sorry.