PaddlePaddle / PaddleHub

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)【安全加固,暂停交互,请耐心等待】
https://www.paddlepaddle.org.cn/hub
Apache License 2.0
12.67k stars 2.08k forks source link

请问如何把paddlehub的模型发布为百度BML的服务 #1260

Open guojiahuiEmily opened 3 years ago

guojiahuiEmily commented 3 years ago

比如把这里的对对联的paddlehub模型,发布为BML的服务,如何获取模型,如何写脚本 https://aistudio.baidu.com/aistudio/projectdetail/1558126

为使您的问题得到快速解决,在建立Issue前,请您先通过如下方式搜索是否有相似问题:【搜索issue关键字】【使用labels筛选】【官方文档】

如果您没有查询到相似问题,为快速解决您的提问,建立issue时请提供如下细节信息:

Thank you for contributing to PaddlePaddle. Before submitting the issue, you could search issue in the github in case that th If there is no solution,please make sure that this is an inference issue including the following details : System information -PaddlePaddle version (eg.1.1)or CommitID -CPU: including CPUMKL/OpenBlas/MKLDNN version -GPU: including CUDA/CUDNN version -OS Platform (eg.Mac OS 10.14) -Python version -Cmake orders -C++version.txt -API information Note: You can get most of the information by running summary_env.py. To Reproduce Steps to reproduce the behavior Describe your current behavior Code to reproduce the issue Other info / logs

paddle-bot-old[bot] commented 3 years ago

您好,我们已经收到了您的问题,会安排技术人员尽快解答您的问题,请耐心等待。请您再次检查是否提供了清晰的问题描述、复现代码、环境&版本、报错信息等。同时,您也可以通过查看官网API文档常见问题历史IssueAI社区来寻求解答。祝您生活愉快~

Hi! We've received your issue and please be patient to get responded. We will arrange technicians to answer your questions as soon as possible. Please make sure that you have posted enough message to demo your request. You may also check out the APIFAQGithub Issue and AI community to get the answer.Have a nice day!

hong19860320 commented 3 years ago

@张雪菲帮忙看下吧,谢谢啦~

KPatr1ck commented 3 years ago

你好,可以通过hub serving命令部署PaddleHub的模型 对联模型的部署可以参考ernie_gen_couplet

guojiahuiEmily commented 3 years ago

hub serving 支持不了并发哦。如果是2核cpu,最多就并发2个, 但是运行1次就得4秒。

ShenYuhan commented 3 years ago

多cpu或多gpu都可以实现并发,可以参照https://github.com/PaddlePaddle/PaddleHub/blob/release/v2.0/docs/docs_ch/tutorial/serving.md