issues
search
OpenBMB
/
BMInf
Efficient Inference for Big Models
Apache License 2.0
572
stars
67
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
为什么实际的显存占用总比我设置的多两个G?
#69
Anhforth
opened
1 year ago
0
[BUG] GPU RTX4090 report errors
#68
zc3r
opened
1 year ago
0
[FEATURE] Does BMInf support multiple nodes deployment?
#67
sharlec
opened
1 year ago
0
在使用CPM ANT+上使用BMinf时报错：
#66
lhj-git
opened
1 year ago
0
[FEATURE] Can the framework be combined with Faster Transformer?
#65
vackosar
opened
1 year ago
0
BMInf支持 CPM-Bee/Live 模型吗?
#64
HaishengLiang
opened
1 year ago
1
[FEATURE] full examples with some known models from the HF in a Collab Notebook
#63
vackosar
closed
1 year ago
10
[BUG] TypeError: object of type 'TransformerBlockList' has no len()
#62
jiangliqin
closed
1 year ago
1
[BUG]请问BMInf支持transformers的模型吗？我用BMInf包装模型推理时报错了
#61
L-hongbin
closed
1 year ago
1
[BUG] 存下显存泄漏，及访问过快时候报错
#60
changleilei
closed
2 years ago
1
Examples of CPM-1/2 啥时候出呀，还有生成模型的代码
#59
touwenameng
opened
2 years ago
2
[FEATURE]How to finetune CPM2.1？
#58
drxmy
closed
2 years ago
2
怎样用BMInf加速GLM推理速度
#57
jiangliqin
closed
2 years ago
4
V2
#56
a710128
closed
2 years ago
0
CPM2自动问答任务怎么推理
#55
yuxulingche
opened
2 years ago
1
Update README.md
#54
THUCSTHanxu13
closed
2 years ago
0
Use async free when free_all
#53
clpl
closed
2 years ago
0
[BUG]RuntimeError: cublas error: CUBLAS_STATUS_NOT_SUPPORTED
#52
cuishibin
opened
2 years ago
0
请教CUPY/CUDA
#51
2020zyc
opened
2 years ago
1
[BUG]RuntimeError: Library cublasLt is not initialized
#50
hxl523
opened
2 years ago
0
[BUG] RuntimeError: Unexpected model output: 26239
#49
mali19064
opened
2 years ago
0
Update README-ZH.md
#48
jayzzhou-thu
closed
2 years ago
0
update logo
#47
jayzzhou-thu
closed
2 years ago
0
Doc update
#46
jayzzhou-thu
closed
2 years ago
0
[QUESTION] Is it able to load complete model instead of INT8 model?
#45
skpig
closed
2 years ago
1
[FEATURE] Question: why does CPM1.0 need 2 GPU cards while BMInf only need 1 GPU?
#44
lucasjinreal
opened
2 years ago
4
请问是否支持显存按需调用，如果支持可否给个代码演示
#43
thehzzz
closed
2 years ago
5
v1.0.2
#42
a710128
closed
2 years ago
0
RuntimeError: CUBLAS error: CUBLAS_STATUS_NOT_INITIALIZED [BUG]
#41
fangd123
closed
2 years ago
4
[BUG] Error was raised when importing model in v1.0.x
#40
sdjksdafji
opened
2 years ago
12
Dev
#39
a710128
closed
2 years ago
0
Doc update
#38
jayzzhou-thu
closed
2 years ago
0
Support loading local model
#37
a710128
closed
2 years ago
0
[FEATURE]允许加载本地模型
#36
huhk-sysu
closed
2 years ago
2
Change docs theme
#35
a710128
closed
2 years ago
0
update docs
#34
Kevin99z
closed
2 years ago
0
cpm1 or cpm2 named_parameters() is empty []
#33
RyanYip-Kat
closed
2 years ago
1
Update docs && examples
#32
a710128
closed
2 years ago
0
fill_blank报错，换成别的文本进行填空提示Unexpected model output: 26239
#31
bidoudhd
closed
2 years ago
3
RuntimeError: CUBLAS error: CUBLAS_STATUS_EXECUTION_FAILED[BUG]
#30
zhangxliang
closed
2 years ago
5
CUDA Error: no kernel image is available for execution on the device
#29
AdamBear
closed
2 years ago
2
BMInf 1.0.0
#28
a710128
closed
2 years ago
0
Openprompt
#27
Achazwl
closed
2 years ago
0
QUESTION:请问如何从CPM2.1模型中提取出句向量(输入词则提取词向量)
#26
chenpe32cp
closed
2 years ago
2
请问CPM2.1模型所对应的vocab.txt哪里可以下载？
#25
chenpe32cp
closed
2 years ago
3
是否支持cpm2 finetune repo的模型
#24
2020zyc
closed
2 years ago
4
AttributeError: type object 'cublasLt' has no attribute 'cublasLtHandle_t'
#23
wac81
opened
3 years ago
3
[BUG] RuntimeError: cublas error: CUBLAS_STATUS_NOT_SUPPORTED
#22
mirrorange
closed
3 years ago
1
我们收集的是医疗问答数据怎么训练自己收集的数据呢？[FEATURE]
#21
yunfeihaha
closed
2 years ago
1
[BUG]运行generate_cpm2.py 报value error
#20
xiaoqiao
closed
3 years ago
3
Next