Open anappdev opened 4 months ago
Hey @anappdev,
Can you please try to use int8
as compute type?
import whisperx
model = whisperx.load_model(compute_type="int8")
Hey @anappdev,
Can you please try to use
int8
as compute type?import whisperx model = whisperx.load_model(compute_type="int8")
I used compute_type="int8", when I got that error
This error looks like you have installed the "cpu only" version of torch (pytorch) but your torchaudio doesn't match, and is the gpu version. What method did you use to install torch and torchaudio? It seems to be pip from the file paths, but it would be good to confirm.
If you use pip, run
pip3 install torch torchaudio --index-url https://download.pytorch.org/whl/cpu
(add --force-reinstall
if needed to replace the other version)
Trying to install on EC2 Amazon Linux, Number of vCPUs= 4, instance type = t2.xlarge
It gives error Traceback (most recent call last): File "/home/ec2-user/xwhisper.py", line 6, in
import whisperx
File "/mnt/efs/fs1/ml/whisperx/whisperx/init.py", line 1, in
from .transcribe import load_model
File "/mnt/efs/fs1/ml/whisperx/whisperx/transcribe.py", line 9, in
from .alignment import align, load_align_model
File "/mnt/efs/fs1/ml/whisperx/whisperx/alignment.py", line 11, in
import torchaudio
File "/home/ec2-user/.local/lib/python3.9/site-packages/torchaudio/init.py", line 1, in
from torchaudio import ( # noqa: F401
File "/home/ec2-user/.local/lib/python3.9/site-packages/torchaudio/_extension/init.py", line 43, in
_load_lib("libtorchaudio")
File "/home/ec2-user/.local/lib/python3.9/site-packages/torchaudio/_extension/utils.py", line 61, in _load_lib
torch.ops.load_library(path)
File "/home/ec2-user/.local/lib/python3.9/site-packages/torch/_ops.py", line 643, in load_library
ctypes.CDLL(path)
File "/usr/lib64/python3.9/ctypes/init.py", line 374, in init
self._handle = _dlopen(self._name, mode)
OSError: libtorch_cuda.so: cannot open shared object file: No such file or directory
Any support for CPU only environment?