search

Wordcab / wordcab-transcribe

💬 ASR FastAPI server using faster-whisper and Multi-Scale Auto-Tuning Spectral Clustering for diarization.
https://wordcab.github.io/wordcab-transcribe/
MIT License
173 stars 24 forks source link

Improvement: allow NVIDIA NeMo diarization in CPU (not only GPU) #281

Closed michalblaha closed 7 months ago

michalblaha commented 7 months ago

It would be great to allow diarization in CPU instead of GPU to be able to use remote DIARIZE_SERVERs on HW with CPU only.

DiarizeService in https://github.com/Wordcab/wordcab-transcribe/blob/8c967bd0fdb29a8496ab9d32caa6d6c9a7649c03/src/wordcab_transcribe/services/diarization/diarize_service.py#L63 looked that its possible.

Unfortunately I don't know python to prepare you pull request. Sorry.

michalblaha commented 7 months ago

Docker with ASR_TYPE=only_diarization can be started without GPU (and without --gpus all parameter) and it's running CPU only.