search

modelscope / FunClip

Open-source, accurate and easy-to-use video speech recognition & clipping tool, LLM based AI clipping intergrated.
MIT License
3.37k stars 360 forks source link

报错NameError: name 'ClusterBackend' is not defined #16

Closed llzzzzoo closed 7 months ago

llzzzzoo commented 7 months ago

1.平台：vmware虚拟机下的

Linux version 6.5.0-21-generic (buildd@lcy02-amd64-091) (x86_64-linux-gnu-gcc-12 (Ubuntu 12.3.0-1ubuntu1~22.04) 12.3.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #21~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Fri Feb 9 13:32:52 UTC 2

2.报错情况：

(ParaClipper) $ python paraclipper/launch.py
If you want to use the speaker diarization, please `pip install hdbscan`
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
2024-03-02 22:31:26,478 - modelscope - INFO - PyTorch version 2.2.1 Found.
2024-03-02 22:31:26,483 - modelscope - INFO - TensorFlow version 2.13.1 Found.
2024-03-02 22:31:26,485 - modelscope - INFO - Loading ast index from /home/lzo/.cache/modelscope/ast_indexer
2024-03-02 22:31:26,909 - modelscope - INFO - Loading done! Current index file version is 1.12.0, with md5 a986dd5e37b563e607171cc5fb7e9553 and a total number of 964 components indexed
2024-03-02 22:31:27,715 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: /home/lzo/.cache/modelscope/hub/iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch/model.pt
2024-03-02 22:31:41,582 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: /home/lzo/.cache/modelscope/hub/damo/speech_fsmn_vad_zh-cn-16k-common-pytorch/model.pt
2024-03-02 22:31:42,485 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: /home/lzo/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch/model.pt
2024-03-02 22:31:44,738 - modelscope - INFO - Use user-specified model revision: v2.0.2
ckpt: /home/lzo/.cache/modelscope/hub/damo/speech_campplus_sv_zh-cn_16k-common/campplus_cn_common.bin
Traceback (most recent call last):
  File "paraclipper/launch.py", line 7, in <module>
    funasr_model = AutoModel(model="iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch",
  File "/home/lzo/anaconda3/envs/ParaClipper/lib/python3.8/site-packages/funasr/auto/auto_model.py", line 126, in __init__
    self.cb_model = ClusterBackend().to(kwargs["device"])
NameError: name 'ClusterBackend' is not defined

3.虚拟环境下的包

_libgcc_mutex             0.1                        main  
_openmp_mutex             5.1                       1_gnu  
absl-py                   2.1.0                    pypi_0    pypi
accelerate                0.27.2                   pypi_0    pypi
addict                    2.4.0                    pypi_0    pypi
aiofiles                  23.2.1                   pypi_0    pypi
aiohttp                   3.9.3                    pypi_0    pypi
aiosignal                 1.3.1                    pypi_0    pypi
albumentations            1.3.1                    pypi_0    pypi
aliyun-python-sdk-core    2.14.0                   pypi_0    pypi
aliyun-python-sdk-kms     2.16.2                   pypi_0    pypi
altair                    5.2.0                    pypi_0    pypi
annotated-types           0.6.0                    pypi_0    pypi
antlr4-python3-runtime    4.8                      pypi_0    pypi
anyio                     4.3.0                    pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
async-timeout             4.0.3                    pypi_0    pypi
attrs                     23.2.0                   pypi_0    pypi
audioread                 3.0.1                    pypi_0    pypi
av                        11.0.0                   pypi_0    pypi
backports-zoneinfo        0.2.1                    pypi_0    pypi
bitarray                  2.9.2                    pypi_0    pypi
black                     24.2.0                   pypi_0    pypi
blas                      1.0                         mkl  
blis                      0.7.11                   pypi_0    pypi
blobfile                  2.1.1                    pypi_0    pypi
bmt-clipit                1.0                      pypi_0    pypi
boto3                     1.34.54                  pypi_0    pypi
botocore                  1.34.54                  pypi_0    pypi
brotli-python             1.0.9            py38h6a678d5_7  
bzip2                     1.0.8                h5eee18b_5  
ca-certificates           2023.12.12           h06a4308_0  
cachetools                5.3.3                    pypi_0    pypi
catalogue                 2.0.10                   pypi_0    pypi
certifi                   2024.2.2         py38h06a4308_0  
cffi                      1.16.0                   pypi_0    pypi
chardet                   5.2.0                    pypi_0    pypi
charset-normalizer        3.3.2                    pypi_0    pypi
chumpy                    0.70                     pypi_0    pypi
click                     8.1.7                    pypi_0    pypi
clip                      1.0                      pypi_0    pypi
cloudpathlib              0.16.0                   pypi_0    pypi
colorama                  0.4.6                    pypi_0    pypi
coloredlogs               15.0.1                   pypi_0    pypi
confection                0.1.4                    pypi_0    pypi
contextlib2               21.6.0                   pypi_0    pypi
contourpy                 1.1.1                    pypi_0    pypi
control-ldm               0.0.1                    pypi_0    pypi
cpuonly                   2.0                           0    pytorch
crcmod                    1.7                      pypi_0    pypi
cryptography              42.0.5                   pypi_0    pypi
cycler                    0.12.1                   pypi_0    pypi
cymem                     2.0.8                    pypi_0    pypi
cython                    3.0.8                    pypi_0    pypi
datasets                  2.18.0                   pypi_0    pypi
ddpm-guided-diffusion     0.0.0                    pypi_0    pypi
decorator                 4.4.2                    pypi_0    pypi
descartes                 1.1.0                    pypi_0    pypi
diffusers                 0.26.3                   pypi_0    pypi
dill                      0.3.8                    pypi_0    pypi
easydict                  1.12                     pypi_0    pypi
easyrobust                0.2.4                    pypi_0    pypi
edit-distance             1.0.6                    pypi_0    pypi
editdistance              0.8.1                    pypi_0    pypi
einops                    0.7.0                    pypi_0    pypi
embeddings                0.0.8                    pypi_0    pypi
emoji                     2.10.1                   pypi_0    pypi
exceptiongroup            1.2.0                    pypi_0    pypi
face-alignment            1.4.1                    pypi_0    pypi
fairscale                 0.4.13                   pypi_0    pypi
fairseq                   0.12.2                   pypi_0    pypi
fastai                    2.7.14                   pypi_0    pypi
fastapi                   0.110.0                  pypi_0    pypi
fastcore                  1.5.29                   pypi_0    pypi
fastdownload              0.0.7                    pypi_0    pypi
fastprogress              1.0.3                    pypi_0    pypi
ffmpeg                    1.4                      pypi_0    pypi
ffmpeg-python             0.2.0                    pypi_0    pypi
ffmpy                     0.3.2                    pypi_0    pypi
filelock                  3.13.1           py38h06a4308_0  
fire                      0.5.0                    pypi_0    pypi
flake8                    7.0.0                    pypi_0    pypi
flatbuffers               23.5.26                  pypi_0    pypi
fonttools                 4.49.0                   pypi_0    pypi
freetype                  2.12.1               h4a9f257_0  
frozenlist                1.4.1                    pypi_0    pypi
fsspec                    2024.2.0                 pypi_0    pypi
ftfy                      6.1.3                    pypi_0    pypi
funasr                    1.0.11                   pypi_0    pypi
future                    1.0.0                    pypi_0    pypi
fvcore                    0.1.5.post20221221          pypi_0    pypi
gast                      0.4.0                    pypi_0    pypi
gmp                       6.2.1                h295c915_3  
gmpy2                     2.1.2            py38heeb90bb_0  
gnutls                    3.6.15               he1e5248_0  
google-auth               2.28.1                   pypi_0    pypi
google-auth-oauthlib      1.0.0                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
gradio                    4.19.2                   pypi_0    pypi
gradio-client             0.10.1                   pypi_0    pypi
grpcio                    1.62.0                   pypi_0    pypi
h11                       0.14.0                   pypi_0    pypi
h5py                      3.10.0                   pypi_0    pypi
httpcore                  1.0.4                    pypi_0    pypi
httpx                     0.27.0                   pypi_0    pypi
huggingface-hub           0.21.3                   pypi_0    pypi
humanfriendly             10.0                     pypi_0    pypi
hydra-core                1.0.7                    pypi_0    pypi
idna                      3.6                      pypi_0    pypi
imageio                   2.34.0                   pypi_0    pypi
imageio-ffmpeg            0.4.9                    pypi_0    pypi
imgaug                    0.4.0                    pypi_0    pypi
importlib-metadata        7.0.1                    pypi_0    pypi
importlib-resources       6.1.2                    pypi_0    pypi
iniconfig                 2.0.0                    pypi_0    pypi
intel-openmp              2023.1.0         hdb19cb5_46306  
iopath                    0.1.10                   pypi_0    pypi
jaconv                    0.3.4                    pypi_0    pypi
jamo                      0.4.1                    pypi_0    pypi
jieba                     0.42.1                   pypi_0    pypi
jinja2                    3.1.3            py38h06a4308_0  
jmespath                  0.10.0                   pypi_0    pypi
joblib                    1.3.2                    pypi_0    pypi
jpeg                      9e                   h5eee18b_1  
jsonschema                4.21.1                   pypi_0    pypi
jsonschema-specifications 2023.12.1                pypi_0    pypi
kaldiio                   2.18.0                   pypi_0    pypi
keras                     2.13.1                   pypi_0    pypi
kiwisolver                1.4.5                    pypi_0    pypi
kornia                    0.7.1                    pypi_0    pypi
lame                      3.100                h7b6447c_0  
langcodes                 3.3.0                    pypi_0    pypi
lap                       0.4.0                    pypi_0    pypi
lazy-loader               0.3                      pypi_0    pypi
lcms2                     2.12                 h3be6417_0  
ld_impl_linux-64          2.38                 h1181459_1  
lerc                      3.0                  h295c915_0  
libclang                  16.0.6                   pypi_0    pypi
libdeflate                1.17                 h5eee18b_1  
libffi                    3.4.4                h6a678d5_0  
libgcc-ng                 11.2.0               h1234567_1  
libgomp                   11.2.0               h1234567_1  
libiconv                  1.16                 h7f8727e_2  
libidn2                   2.3.4                h5eee18b_0  
libjpeg-turbo             2.0.0                h9bf148f_0    pytorch
libpng                    1.6.39               h5eee18b_0  
librosa                   0.10.1                   pypi_0    pypi
libstdcxx-ng              11.2.0               h1234567_1  
libtasn1                  4.19.0               h5eee18b_0  
libtiff                   4.5.1                h6a678d5_0  
libunistring              0.9.10               h27cfd23_0  
libwebp-base              1.3.2                h5eee18b_0  
lightning-utilities       0.10.1                   pypi_0    pypi
llvm-openmp               14.0.6               h9e868ea_0  
llvmlite                  0.41.1                   pypi_0    pypi
lmdb                      1.4.1                    pypi_0    pypi
lpips                     0.1.4                    pypi_0    pypi
lxml                      4.9.4                    pypi_0    pypi
lyft-dataset-sdk          0.0.8                    pypi_0    pypi
lz4-c                     1.9.4                h6a678d5_0  
markdown                  3.5.2                    pypi_0    pypi
markdown-it-py            3.0.0                    pypi_0    pypi
markupsafe                2.1.5                    pypi_0    pypi
matplotlib                3.5.3                    pypi_0    pypi
mccabe                    0.7.0                    pypi_0    pypi
mdurl                     0.1.2                    pypi_0    pypi
megatron-util             1.3.2                    pypi_0    pypi
mkl                       2023.1.0         h213fc3f_46344  
mkl-service               2.4.0            py38h5eee18b_1  
mkl_fft                   1.3.8            py38h5eee18b_0  
mkl_random                1.2.4            py38hdb19cb5_0  
ml-collections            0.1.1                    pypi_0    pypi
mmcls                     0.25.0                   pypi_0    pypi
mmdet                     2.28.2                   pypi_0    pypi
mmdet3d                   1.0.0a1                  pypi_0    pypi
mmsegmentation            0.30.0                   pypi_0    pypi
mock                      5.1.0                    pypi_0    pypi
modelscope                1.12.0                   pypi_0    pypi
moviepy                   1.0.3                    pypi_0    pypi
mpc                       1.1.0                h10f8cd9_1  
mpfr                      4.0.2                hb69a4c5_1  
mpmath                    1.3.0            py38h06a4308_0  
msgpack                   1.0.8                    pypi_0    pypi
multidict                 6.0.5                    pypi_0    pypi
multiprocess              0.70.16                  pypi_0    pypi
murmurhash                1.0.10                   pypi_0    pypi
mypy-extensions           1.0.0                    pypi_0    pypi
ncurses                   6.4                  h6a678d5_0  
nerfacc                   0.2.2                    pypi_0    pypi
nettle                    3.7.3                hbbd107a_1  
networkx                  3.1              py38h06a4308_0  
ninja                     1.11.1.1                 pypi_0    pypi
nltk                      3.8.1                    pypi_0    pypi
numba                     0.58.1                   pypi_0    pypi
numpy                     1.24.4                   pypi_0    pypi
numpy-base                1.24.3           py38h060ed82_1  
nuscenes-devkit           1.1.11                   pypi_0    pypi
oauthlib                  3.2.2                    pypi_0    pypi
omegaconf                 2.0.6                    pypi_0    pypi
onnx                      1.15.0                   pypi_0    pypi
onnxruntime               1.17.1                   pypi_0    pypi
onnxsim                   0.4.35                   pypi_0    pypi
open-clip-torch           2.24.0                   pypi_0    pypi
opencv-python             4.9.0.80                 pypi_0    pypi
opencv-python-headless    4.9.0.80                 pypi_0    pypi
openh264                  2.1.1                h4ff587b_0  
openjpeg                  2.4.0                h3ad879b_0  
openssl                   3.0.13               h7f8727e_0  
opt-einsum                3.3.0                    pypi_0    pypi
orjson                    3.9.15                   pypi_0    pypi
oss2                      2.18.4                   pypi_0    pypi
packaging                 23.2                     pypi_0    pypi
paint-ldm                 0.0.0                    pypi_0    pypi
pandas                    2.0.3                    pypi_0    pypi
panopticapi               0.1                      pypi_0    pypi
pathspec                  0.12.1                   pypi_0    pypi
pillow                    10.2.0           py38h5eee18b_0  
pip                       23.3.1           py38h06a4308_0  
pkgutil-resolve-name      1.3.10                   pypi_0    pypi
platformdirs              4.2.0                    pypi_0    pypi
plotly                    5.19.0                   pypi_0    pypi
pluggy                    1.4.0                    pypi_0    pypi
plyfile                   1.0.3                    pypi_0    pypi
pooch                     1.8.1                    pypi_0    pypi
portalocker               2.8.2                    pypi_0    pypi
preshed                   3.0.9                    pypi_0    pypi
prettytable               3.10.0                   pypi_0    pypi
proglog                   0.1.10                   pypi_0    pypi
protobuf                  3.20.3                   pypi_0    pypi
psutil                    5.9.8                    pypi_0    pypi
pyarrow                   15.0.0                   pypi_0    pypi
pyarrow-hotfix            0.6                      pypi_0    pypi
pyasn1                    0.5.1                    pypi_0    pypi
pyasn1-modules            0.3.0                    pypi_0    pypi
pybind11                  2.11.1                   pypi_0    pypi
pyclipper                 1.3.0.post5              pypi_0    pypi
pycocotools               2.0.7                    pypi_0    pypi
pycodestyle               2.11.1                   pypi_0    pypi
pycparser                 2.21                     pypi_0    pypi
pycryptodome              3.20.0                   pypi_0    pypi
pycryptodomex             3.20.0                   pypi_0    pypi
pydantic                  2.6.3                    pypi_0    pypi
pydantic-core             2.16.3                   pypi_0    pypi
pydub                     0.25.1                   pypi_0    pypi
pyflakes                  3.2.0                    pypi_0    pypi
pygments                  2.17.2                   pypi_0    pypi
pymcubes                  0.1.4                    pypi_0    pypi
pynndescent               0.5.11                   pypi_0    pypi
pyparsing                 3.1.1                    pypi_0    pypi
pyquaternion              0.9.9                    pypi_0    pypi
pysocks                   1.7.1            py38h06a4308_0  
pytest                    8.0.2                    pypi_0    pypi
pythainlp                 5.0.1                    pypi_0    pypi
python                    3.8.18               h955ad1f_0  
python-crfsuite           0.9.10                   pypi_0    pypi
python-dateutil           2.9.0.post0              pypi_0    pypi
python-multipart          0.0.9                    pypi_0    pypi
pytorch                   2.2.1               py3.8_cpu_0    pytorch
pytorch-lightning         2.2.0.post0              pypi_0    pypi
pytorch-mutex             1.0                         cpu    pytorch
pytorch-wpe               0.0.1                    pypi_0    pypi
pytz                      2024.1                   pypi_0    pypi
pyvi                      0.1.1                    pypi_0    pypi
pywavelets                1.4.1                    pypi_0    pypi
pyyaml                    6.0.1            py38h5eee18b_0  
qudida                    0.0.4                    pypi_0    pypi
readline                  8.2                  h5eee18b_0  
referencing               0.33.0                   pypi_0    pypi
regex                     2023.12.25               pypi_0    pypi
requests                  2.31.0           py38h06a4308_1  
requests-oauthlib         1.3.1                    pypi_0    pypi
rich                      13.7.1                   pypi_0    pypi
rouge                     1.0.1                    pypi_0    pypi
rpds-py                   0.18.0                   pypi_0    pypi
rsa                       4.9                      pypi_0    pypi
ruff                      0.3.0                    pypi_0    pypi
s3transfer                0.10.0                   pypi_0    pypi
sacrebleu                 2.4.0                    pypi_0    pypi
sacremoses                0.1.1                    pypi_0    pypi
safetensors               0.4.2                    pypi_0    pypi
scikit-image              0.19.3                   pypi_0    pypi
scikit-learn              1.3.2                    pypi_0    pypi
scipy                     1.10.1                   pypi_0    pypi
semantic-version          2.10.0                   pypi_0    pypi
sentencepiece             0.2.0                    pypi_0    pypi
seqeval                   1.2.2                    pypi_0    pypi
setuptools                68.2.2           py38h06a4308_0  
setuptools-scm            8.0.4                    pypi_0    pypi
shapely                   1.8.5.post1              pypi_0    pypi
shellingham               1.5.4                    pypi_0    pypi
shotdetect-scenedetect-lgss 0.0.4                    pypi_0    pypi
simplejson                3.19.2                   pypi_0    pypi
six                       1.16.0                   pypi_0    pypi
sklearn-crfsuite          0.3.6                    pypi_0    pypi
smart-open                6.4.0                    pypi_0    pypi
smplx                     0.1.28                   pypi_0    pypi
sniffio                   1.3.1                    pypi_0    pypi
sortedcontainers          2.4.0                    pypi_0    pypi
soundfile                 0.12.1                   pypi_0    pypi
soxr                      0.3.7                    pypi_0    pypi
spacy                     3.7.4                    pypi_0    pypi
spacy-legacy              3.0.12                   pypi_0    pypi
spacy-loggers             1.0.5                    pypi_0    pypi
sqlite                    3.41.2               h5eee18b_0  
srsly                     2.4.8                    pypi_0    pypi
stanza                    1.8.1                    pypi_0    pypi
starlette                 0.36.3                   pypi_0    pypi
subword-nmt               0.3.8                    pypi_0    pypi
sympy                     1.12             py38h06a4308_0  
tabulate                  0.9.0                    pypi_0    pypi
tbb                       2021.8.0             hdb19cb5_0  
tenacity                  8.2.3                    pypi_0    pypi
tensorboard               2.13.0                   pypi_0    pypi
tensorboard-data-server   0.7.2                    pypi_0    pypi
tensorboardx              2.6.2.2                  pypi_0    pypi
tensorflow                2.13.1                   pypi_0    pypi
tensorflow-estimator      2.13.0                   pypi_0    pypi
tensorflow-io-gcs-filesystem 0.34.0                   pypi_0    pypi
termcolor                 2.4.0                    pypi_0    pypi
terminaltables            3.1.10                   pypi_0    pypi
tf-slim                   1.1.0                    pypi_0    pypi
thinc                     8.2.3                    pypi_0    pypi
thop                      0.1.1-2209072238          pypi_0    pypi
threadpoolctl             3.3.0                    pypi_0    pypi
tifffile                  2023.7.10                pypi_0    pypi
timm                      0.5.4                    pypi_0    pypi
tk                        8.6.12               h1ccaba5_0  
tokenizers                0.15.2                   pypi_0    pypi
toml                      0.10.2                   pypi_0    pypi
tomli                     2.0.1                    pypi_0    pypi
tomlkit                   0.12.0                   pypi_0    pypi
toolz                     0.12.1                   pypi_0    pypi
torch-complex             0.4.3                    pypi_0    pypi
torch-scatter             2.1.2                    pypi_0    pypi
torchaudio                2.2.1                  py38_cpu    pytorch
torchmetrics              1.3.1                    pypi_0    pypi
torchsummary              1.5.1                    pypi_0    pypi
torchvision               0.17.1                 py38_cpu    pytorch
tqdm                      4.66.2                   pypi_0    pypi
transformers              4.38.2                   pypi_0    pypi
trimesh                   2.35.39                  pypi_0    pypi
typer                     0.9.0                    pypi_0    pypi
typing-extensions         4.10.0                   pypi_0    pypi
typing_extensions         4.9.0            py38h06a4308_1  
tzdata                    2024.1                   pypi_0    pypi
ujson                     5.9.0                    pypi_0    pypi
umap-learn                0.5.5                    pypi_0    pypi
urllib3                   2.2.1                    pypi_0    pypi
utils                     1.0.2                    pypi_0    pypi
uvicorn                   0.27.1                   pypi_0    pypi
videofeatures-clipit      1.0                      pypi_0    pypi
wasabi                    1.1.2                    pypi_0    pypi
wcwidth                   0.2.13                   pypi_0    pypi
weasel                    0.3.4                    pypi_0    pypi
websockets                11.0.3                   pypi_0    pypi
werkzeug                  3.0.1                    pypi_0    pypi
wheel                     0.41.2           py38h06a4308_0  
wrapt                     1.16.0                   pypi_0    pypi
xxhash                    3.4.1                    pypi_0    pypi
xz                        5.4.6                h5eee18b_0  
yacs                      0.1.8                    pypi_0    pypi
yaml                      0.2.5                h7b6447c_0  
yapf                      0.40.2                   pypi_0    pypi
yarl                      1.9.4                    pypi_0    pypi
zhconv                    1.4.3                    pypi_0    pypi
zipp                      3.17.0                   pypi_0    pypi
zlib                      1.2.13               h5eee18b_0  
zstd                      1.5.5                hc292b87_0
R1ckShi commented 7 months ago

在你发的log第二行有哈，安装一下hdbscan

llzzzzoo commented 7 months ago

安装完hdbscan和rotary_embedding_torch输入python paraclipper/launch.py 又报错When localhost is not accessible, a shareable link must be created. Please set share=True or check your proxy settings to allow access to localhost 不过在launch.py文件里面添加了

import os
os.environ["no_proxy"] = "localhost,127.0.0.1,::1"

后运行成功 image