search

netease-youdao / BCEmbedding

Netease Youdao's open-source embedding and reranker models for RAG products.
Apache License 2.0
1.3k stars 85 forks source link

多GPU并发调用报错：Core dumped #71

Closed melove93 closed 1 month ago

melove93 commented 1 month ago

Bcemedding模型，使用多GPU进行多线程并发调用时出现Segmentation fault (core dumped)。单GPU并发调用不报错，这个模型只能进行单GPU并发调用吗？

shenlei1020 commented 1 month ago

什么推理框架？什么服务框架？

melove93 commented 1 month ago

没有使用推理框架，使用flask服务框架。可以使用什么推理框架吗？

shenlei1020 commented 1 month ago

这个参考一下，https://github.com/netease-youdao/BCEmbedding/issues/70

melove93 commented 1 month ago

OK，我试试