kiron111
commented
2 weeks ago I solve it, just by not using directly the poetry, without building docker. Thankyou again, for your projects, it helps me a lot
Open kiron111 opened 3 weeks ago
kiron111
commented
2 weeks ago I solve it, just by not using directly the poetry, without building docker. Thankyou again, for your projects, it helps me a lot
randomradio
commented
4 days ago Providing a working copy of Docker.cpu to run on arm64.
M1 Mac.
FROM ubuntu:22.04
# `ffmpeg` is installed because without it `gradio` won't work with mp3(possible others as well) files
# hadolint ignore=DL3008,DL3015,DL4006
RUN apt-get update && \
apt-get install -y ffmpeg software-properties-common && \
apt-get install -y libsndfile1 && \
add-apt-repository ppa:deadsnakes/ppa && \
DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends python3.12 python3.12-distutils && \
apt-get clean && \
rm -rf /var/lib/apt/lists/*
WORKDIR /root/faster-whisper-server
COPY requirements-dev.txt .
RUN --mount=from=ghcr.io/astral-sh/uv:latest,source=/uv,target=/bin/uv \
uv pip install --system --python 3.12 --no-cache -r requirements-dev.txt
COPY ./faster_whisper_server ./faster_whisper_server
ENV WHISPER__MODEL=Systran/faster-whisper-medium.en
ENV WHISPER__INFERENCE_DEVICE=cpu
ENV WHISPER__COMPUTE_TYPE=int8
ENV UVICORN_HOST=0.0.0.0
ENV UVICORN_PORT=8000
EXPOSE 8000
CMD ["uvicorn", "faster_whisper_server.main:app"]Build with:
docker build -f Dockerfile.cpu -t faster-whisper-server .
Simply start your container and VOILÀ.
I just build docker(just pull from fredirz's docker hub) for my arm64 computer (a RK3588 board), after I run the docker, it failed. Becase I cannot launch the container, so I cannot install the missing module/package to fix it....
Is that a way to run faster-whisper-server on arm64 device? (just by cpu, I think a medium model is suitable for a sbc)