search

bolna-ai / bolna

End-to-end platform for building voice first multimodal agents
https://playground.bolna.dev
MIT License
310 stars 89 forks source link

Fatal error with docker on whisper-melo-llama3 #305

Open acastry opened 1 week ago

acastry commented 1 week ago

Hello there is a fatal error when trying to deploy whisper-melo-llama3 First it is necessary to modify bolna_server.Dockerfile to get the last repository right ? RUN pip install --force-reinstall git+https://github.com/bolna-ai/bolna@MeloTTS to: RUN pip install --force-reinstall git+https://github.com/bolna-ai/bolna@master

Then the fatal error i guess in MeloTTS : ` => [melo-app 5/10] RUN git clone https://github.com/bolna-ai/MeloTTS 2.1s => [melo-app 6/10] RUN pip install fastapi uvicorn torchaudio 46.9s => [bolna-app 12/14] RUN pip install pydub==0.25.1 1.6s => [bolna-app 13/14] RUN pip install ffprobe 2.7s => [bolna-app 14/14] RUN pip install aiofiles 1.3s => ERROR [bolna-app] exporting to docker image format 183.9s => => exporting layers 112.2s => => exporting manifest sha256:06c40a005b2f6040981b04d677a5994fa440a4b8b0a826bb7193ffae940856e5 0.0s => => exporting config sha256:89c37bae6f62aca0d4d57689610467537971fa097ea12c00147f3fc21cd900d5 0.0s => => sending tarball 71.7s => [melo-app 7/10] RUN cp -a MeloTTS/. . 0.7s => [melo-app 8/10] RUN python -m pip cache purge 0.8s => ERROR [melo-app 9/10] RUN pip install --no-cache-dir txtsplit torch torchaudio cached_path transformers==4.27.4 mecab-python3==1.0.5 num2words==0.5.12 unidic_lite unidic mecab-python3==1.0.5 pykaka 147.7s => [whisper-app 9/12] RUN pip install git+https://github.com/SYSTRAN/faster-whisper.git 8.6s => [whisper-app 10/12] RUN pip install transformers 11.1s => [whisper-app 11/12] RUN ct2-transformers-converter --model openai/whisper-small --copy_files preprocessor_config.json --output_dir ./Server/ASR/whisper_small --quantization float16 33.0s => [whisper-app 12/12] WORKDIR Server 0.0s => CANCELED [whisper-app] exporting to docker image format 87.4s => => exporting layers 87.4s => CANCELED [bolna-app bolna-app] importing to docker 17.5s

[bolna-app] exporting to docker image format:

[melo-app 9/10] RUN pip install --no-cache-dir txtsplit torch torchaudio cached_path transformers==4.27.4 mecab-python3==1.0.5 num2words==0.5.12 unidic_lite unidic mecab-python3==1.0.5 pykakasi==2.2.1 fugashi==1.3.0 g2p_en==2.1.0 anyascii==0.3.2 jamo==0.4.1 gruut[de,es,fr]==2.2.3 g2pkk>=0.1.1 librosa==0.9.1 pydub==0.25.1 eng_to_ipa==0.0.2 inflect==7.0.0 unidecode==1.3.7 pypinyin==0.50.0 cn2an==0.5.22 jieba==0.42.1 langid==1.1.6 tqdm tensorboard==2.16.2 loguru==0.7.2: 132.9 error: subprocess-exited-with-error 132.9
132.9 × python setup.py bdist_wheel did not run successfully. 132.9 │ exit code: 1 132.9 ╰─> [24 lines of output] 132.9 running bdist_wheel 132.9 running build 132.9 running build_py 132.9 creating build 132.9 creating build/lib.linux-aarch64-cpython-310 132.9 creating build/lib.linux-aarch64-cpython-310/pycrfsuite 132.9 copying pycrfsuite/_dumpparser.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite 132.9 copying pycrfsuite/_logparser.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite 132.9 copying pycrfsuite/init.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite 132.9 running build_ext 132.9 building 'pycrfsuite._pycrfsuite' extension 132.9 creating build/temp.linux-aarch64-cpython-310 132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite 132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib 132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb 132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb/src 132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/crf 132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/crf/src 132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/swig 132.9 creating build/temp.linux-aarch64-cpython-310/liblbfgs 132.9 creating build/temp.linux-aarch64-cpython-310/liblbfgs/lib 132.9 creating build/temp.linux-aarch64-cpython-310/pycrfsuite 132.9 gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/local/include/python3.10 -c -std=c99 crfsuite/lib/cqdb/src/cqdb.c -o build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb/src/cqdb.o 132.9 error: command 'gcc' failed: No such file or directory 132.9 [end of output] 132.9
132.9 note: This error originates from a subprocess, and is likely not a problem with pip. 132.9 ERROR: Failed building wheel for python-crfsuite 139.5 error: subprocess-exited-with-error 139.5
139.5 × Running setup.py install for python-crfsuite did not run successfully. 139.5 │ exit code: 1 139.5 ╰─> [26 lines of output] 139.5 running install 139.5 /usr/local/lib/python3.10/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 139.5 warnings.warn( 139.5 running build 139.5 running build_py 139.5 creating build 139.5 creating build/lib.linux-aarch64-cpython-310 139.5 creating build/lib.linux-aarch64-cpython-310/pycrfsuite 139.5 copying pycrfsuite/_dumpparser.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite 139.5 copying pycrfsuite/_logparser.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite 139.5 copying pycrfsuite/init.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite 139.5 running build_ext 139.5 building 'pycrfsuite._pycrfsuite' extension 139.5 creating build/temp.linux-aarch64-cpython-310 139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite 139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib 139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb 139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb/src 139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/crf 139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/crf/src 139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/swig 139.5 creating build/temp.linux-aarch64-cpython-310/liblbfgs 139.5 creating build/temp.linux-aarch64-cpython-310/liblbfgs/lib 139.5 creating build/temp.linux-aarch64-cpython-310/pycrfsuite 139.5 gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/local/include/python3.10 -c -std=c99 crfsuite/lib/cqdb/src/cqdb.c -o build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb/src/cqdb.o 139.5 error: command 'gcc' failed: No such file or directory 139.5 [end of output] 139.5
139.5 note: This error originates from a subprocess, and is likely not a problem with pip. 139.5 error: legacy-install-failure 139.5 139.5 × Encountered error while trying to install package. 139.5 ╰─> python-crfsuite 139.5 139.5 note: This is an issue with the package mentioned above, not pip. 139.5 hint: See above for output from the failure. 141.0 141.0 [notice] A new release of pip is available: 23.0.1 -> 24.1.1 141.0 [notice] To update, run: pip install --upgrade pip

failed to solve: process "/bin/sh -c pip install --no-cache-dir txtsplit torch torchaudio cached_path transformers==4.27.4 mecab-python3==1.0.5 num2words==0.5.12 unidic_lite unidic mecab-python3==1.0.5 pykakasi==2.2.1 fugashi==1.3.0 g2p_en==2.1.0 anyascii==0.3.2 jamo==0.4.1 gruut[de,es,fr]==2.2.3 g2pkk>=0.1.1 librosa==0.9.1 pydub==0.25.1 eng_to_ipa==0.0.2 inflect==7.0.0 unidecode==1.3.7 pypinyin==0.50.0 cn2an==0.5.22 jieba==0.42.1 langid==1.1.6 tqdm tensorboard==2.16.2 loguru==0.7.2" did not complete successfully: exit code: 1 `

Thanks for your support,

prateeksachan commented 1 week ago

thanks @acastry for reporting this. Will debug and get it fixed.

prateeksachan commented 4 days ago

hey @acastry did you try deploying this in GPU-based instance? melo_server and whisper_server require GPU instances as mentioned in their docker config.

https://github.com/bolna-ai/bolna/blob/aafb2133ce2f1b9a837c57eb2b8e3efb7e643833/examples/whisper-melo-llama3/docker-compose.yml#L68-L82