linuxserver / docker-faster-whisper

GNU General Public License v3.0
93 stars 4 forks source link

[BUG] gpu-2.0.0-ls42 don't work #22

Closed MorganMLGman closed 3 weeks ago

MorganMLGman commented 3 weeks ago

Is there an existing issue for this?

Current Behavior

whisper  | [migrations] started
whisper  | [migrations] no migrations found
whisper  | ───────────────────────────────────────
whisper  |
whisper  |       ██╗     ███████╗██╗ ██████╗
whisper  |       ██║     ██╔════╝██║██╔═══██╗
whisper  |       ██║     ███████╗██║██║   ██║
whisper  |       ██║     ╚════██║██║██║   ██║
whisper  |       ███████╗███████║██║╚██████╔╝
whisper  |       ╚══════╝╚══════╝╚═╝ ╚═════╝
whisper  |
whisper  |    Brought to you by linuxserver.io
whisper  | ───────────────────────────────────────
whisper  |
whisper  | To support LSIO projects visit:
whisper  | https://www.linuxserver.io/donate/
whisper  |
whisper  | ───────────────────────────────────────
whisper  | GID/UID
whisper  | ───────────────────────────────────────
whisper  |
whisper  | User UID:    1000
whisper  | User GID:    1000
whisper  | ───────────────────────────────────────
whisper  | Linuxserver.io version: 2.0.0-ls42
whisper  | Build-date: 2024-10-27T06:41:16+00:00
whisper  | ───────────────────────────────────────
whisper  |
whisper  | [custom-init] No custom files found, skipping...
whisper  | INFO:__main__:Ready
whisper  | Connection to localhost (127.0.0.1) 10300 port [tcp/*] succeeded!
whisper  | [ls.io-init] done.
whisper  | INFO:faster_whisper:Processing audio with duration 00:10.880
whisper  | Unable to load any of {libcudnn_ops.so.9.1.0, libcudnn_ops.so.9.1, libcudnn_ops.so.9, libcudnn_ops.so}
whisper  | Invalid handle. Cannot load symbol cudnnCreateTensorDescriptor
whisper  | INFO:__main__:Ready

Expected Behavior

whisper  | [migrations] started
whisper  | [migrations] no migrations found
whisper  | ───────────────────────────────────────
whisper  |
whisper  |       ██╗     ███████╗██╗ ██████╗
whisper  |       ██║     ██╔════╝██║██╔═══██╗
whisper  |       ██║     ███████╗██║██║   ██║
whisper  |       ██║     ╚════██║██║██║   ██║
whisper  |       ███████╗███████║██║╚██████╔╝
whisper  |       ╚══════╝╚══════╝╚═╝ ╚═════╝
whisper  |
whisper  |    Brought to you by linuxserver.io
whisper  | ───────────────────────────────────────
whisper  |
whisper  | To support LSIO projects visit:
whisper  | https://www.linuxserver.io/donate/
whisper  |
whisper  | ───────────────────────────────────────
whisper  | GID/UID
whisper  | ───────────────────────────────────────
whisper  |
whisper  | User UID:    1000
whisper  | User GID:    1000
whisper  | ───────────────────────────────────────
whisper  | Linuxserver.io version: 2.0.0-ls41
whisper  | Build-date: 2024-10-20T06:40:45+00:00
whisper  | ───────────────────────────────────────
whisper  |
whisper  | [custom-init] No custom files found, skipping...
whisper  | INFO:__main__:Ready
whisper  | Connection to localhost (127.0.0.1) 10300 port [tcp/*] succeeded!
whisper  | [ls.io-init] done.
whisper  | INFO:faster_whisper:Processing audio with duration 00:15.000
whisper  | INFO:wyoming_faster_whisper.handler: Dziękuje za oglądanie.
whisper  | INFO:faster_whisper:Processing audio with duration 00:15.000
whisper  | INFO:wyoming_faster_whisper.handler: Dziękuje za oglądanie.
whisper  | INFO:faster_whisper:Processing audio with duration 00:02.080
whisper  | INFO:wyoming_faster_whisper.handler: Jaki jest dziś dzień

Steps To Reproduce

update container

Environment

- OS: Ubuntu 24.04
- How docker service was installed: distro's packagemanager

CPU architecture

x86-64

Docker creation

whisper:
    image: lscr.io/linuxserver/faster-whisper:gpu-2.0.0-ls41
    container_name: whisper
    environment:
      - PUID=$PUID
      - PGID=$PGID
      - TZ=$TZ
      - WHISPER_MODEL=large-v3
      - WHISPER_BEAM=2 #optional
      - WHISPER_LANG=pl #optional
      - NVIDIA_VISIBLE_DEVICES=all
      - NVIDIA_DRIVER_CAPABILITIES=compute,video,utility
    deploy:
      resources:
        reservations:
          devices:
            - capabilities: [gpu]
    volumes:
      - $DOCKER_APPS_DIR/whisper:/config
    ports:
      - 10300:10300
    restart: unless-stopped
    labels:
      - "com.centurylinklabs.watchtower.enable=true"

### Container logs

```bash
already uploaded
github-actions[bot] commented 3 weeks ago

Thanks for opening your first issue here! Be sure to follow the relevant issue templates, or risk having this issue marked as invalid.

thespad commented 3 weeks ago

Looks like ctranslate2 has updated to only support CUDNN 9 but faster-whisper only supports CUDNN 8 so we might have to pin it.

thespad commented 3 weeks ago

Pushing two builds to https://github.com/linuxserver/docker-faster-whisper/pull/23, image names will get posted by the bot once they're available.

First pins ctranslate2 to 4.4.0 with CUDNN 8 Second upgrades CUDNN to 9.

Various linked discussion from https://github.com/SYSTRAN/faster-whisper/issues/1086 suggests faster whisper should work with ctranslate 4.5.0 despite what the docs say, so that one would be preferable rather than pinning ctranslate2 to an older version.

Please can you test them and let me know if one/both/neither work for you.

MorganMLGman commented 3 weeks ago

ghcr.io/linuxserver/lspipepr-faster-whisper:gpu-2.0.0-pkg-b2138dcc-dev-550713281c67d3de93e9724577979e887a40ccdc-pr-23

Works

whisper  | [migrations] started
whisper  | [migrations] no migrations found
whisper  | ───────────────────────────────────────
whisper  |
whisper  |       ██╗     ███████╗██╗ ██████╗
whisper  |       ██║     ██╔════╝██║██╔═══██╗
whisper  |       ██║     ███████╗██║██║   ██║
whisper  |       ██║     ╚════██║██║██║   ██║
whisper  |       ███████╗███████║██║╚██████╔╝
whisper  |       ╚══════╝╚══════╝╚═╝ ╚═════╝
whisper  |
whisper  |    Brought to you by linuxserver.io
whisper  | ───────────────────────────────────────
whisper  |
whisper  | To support LSIO projects visit:
whisper  | https://www.linuxserver.io/donate/
whisper  |
whisper  | ───────────────────────────────────────
whisper  | GID/UID
whisper  | ───────────────────────────────────────
whisper  |
whisper  | User UID:    1000
whisper  | User GID:    1000
whisper  | ───────────────────────────────────────
whisper  | Linuxserver.io version: 2.0.0-pkg-b2138dcc-dev-550713281c67d3de93e9724577979e887a40ccdc-pr-23
whisper  | Build-date: 2024-10-29T09:22:43+00:00
whisper  | ───────────────────────────────────────
whisper  |
whisper  | [custom-init] No custom files found, skipping...
whisper  | INFO:__main__:Ready
whisper  | Connection to localhost (127.0.0.1) 10300 port [tcp/*] succeeded!
whisper  | [ls.io-init] done.
whisper  | INFO:faster_whisper:Processing audio with duration 00:02.150
whisper  | INFO:wyoming_faster_whisper.handler: Jaki mamy dziś dzień?
MorganMLGman commented 3 weeks ago

ghcr.io/linuxserver/lspipepr-faster-whisper:gpu-2.0.0-pkg-b2138dcc-dev-f3a49ddf041bf5ebabd973b04027986e0cc3c451-pr-23

Also works

whisper  | [migrations] started
whisper  | [migrations] no migrations found
whisper  | ───────────────────────────────────────
whisper  |
whisper  |       ██╗     ███████╗██╗ ██████╗
whisper  |       ██║     ██╔════╝██║██╔═══██╗
whisper  |       ██║     ███████╗██║██║   ██║
whisper  |       ██║     ╚════██║██║██║   ██║
whisper  |       ███████╗███████║██║╚██████╔╝
whisper  |       ╚══════╝╚══════╝╚═╝ ╚═════╝
whisper  |
whisper  |    Brought to you by linuxserver.io
whisper  | ───────────────────────────────────────
whisper  |
whisper  | To support LSIO projects visit:
whisper  | https://www.linuxserver.io/donate/
whisper  |
whisper  | ───────────────────────────────────────
whisper  | GID/UID
whisper  | ───────────────────────────────────────
whisper  |
whisper  | User UID:    1000
whisper  | User GID:    1000
whisper  | ───────────────────────────────────────
whisper  | Linuxserver.io version: 2.0.0-pkg-b2138dcc-dev-f3a49ddf041bf5ebabd973b04027986e0cc3c451-pr-23
whisper  | Build-date: 2024-10-29T09:28:25+00:00
whisper  | ───────────────────────────────────────
whisper  |
whisper  | [custom-init] No custom files found, skipping...
whisper  | INFO:__main__:Ready
whisper  | Connection to localhost (127.0.0.1) 10300 port [tcp/*] succeeded!
whisper  | [ls.io-init] done.
whisper  | INFO:faster_whisper:Processing audio with duration 00:02.110
whisper  | INFO:wyoming_faster_whisper.handler: Jak nam jeździ?
whisper  | INFO:faster_whisper:Processing audio with duration 00:02.660
whisper  | INFO:wyoming_faster_whisper.handler: Jaki mamy dziś dzień?
thespad commented 3 weeks ago

Thanks for testing, I'll get the PR reviewed and merged shortly.

thespad commented 3 weeks ago

Fixed via #23