search

OpenBMB / BMInf

Efficient Inference for Big Models
Apache License 2.0
572 stars 67 forks source link

[BUG]RuntimeError: Library cublasLt is not initialized #50

Open hxl523 opened 2 years ago

hxl523 commented 2 years ago

Describe the bug

运行路径https://github.com/OpenBMB/BMInf 的demo时候，出现RuntimeError: Library cublasLt is not initialized错误

Minimal steps to reproduce

import bminf #成功导入 cpm2 = bminf.models.CPM2() #成功定义 cpm2.fill_blank('好') #报错 RuntimeError: Library cublasLt is not initialized Expected behavior

Screenshots

image image

Environment:

NVIDIA-SMI 465.19.01 Driver Version: 465.19.01 NVIDIA A40
CUDA Version: 11.3 Memory:45634MiB