PaddlePaddle / FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
https://www.paddlepaddle.org.cn/fastdeploy
Apache License 2.0
3k stars 465 forks source link

fastdeploy和taskflow不能共存吗? #2257

Open magicleo opened 1 year ago

magicleo commented 1 year ago

温馨提示:根据社区不完全统计,按照模板提问,可以加快回复和解决问题的速度


环境

问题日志及出现问题的操作流程

当同时使用fastdeploy和taskflow部署的时候,会报错Segmentation fault。 但是我线上环境有一些模型已经用taskflow在管理了。需要怎么解决这个问题呢?

`
from paddlenlp import Taskflow import fastdeploy as fd

option = fd.RuntimeOption()
model_path ='/mnt/storage/utc/plm_v2/static/inference.pdmodel'
params_path = '/mnt/storage/utc/plm_v2/static/inference.pdiparams'
option.set_model_path(model_path, params_path)
option.use_gpu(1)
model=fd.Runtime(option)
utcClassification = Taskflow("zero_shot_text_classification",
                             model="utc-xbase",
                             schema=utc_labels,
                             task_path='/mnt/storage/utc/plm_v2',
                             pred_threshold=0,
                             max_seq_len=2048,
                             device_id=0,
                             num_workers=1)

`

jiangjiajun commented 1 year ago

paddle版本多少,试下安装2.4.1看下

magicleo commented 1 year ago

@jiangjiajun paddle版本是以下这些。试了2.4.1也是会崩溃

paddle-bfloat 0.1.7 paddle-pipelines 0.6.1 paddle2onnx 1.0.6 paddlefsl 1.1.0 paddlenlp 2.6.1 paddleocr 2.6.1.3 paddlepaddle 2.5.1 paddlepaddle-gpu 2.5.1.post117

magicleo commented 1 year ago

paddle版本多少,试下安装2.4.1看下

另paddleNLP要求paddlepaddle>=2.5.1

image
watertianyi commented 5 months ago

@magicleo 我也出现这种问题,你解决了吗 我的环境是: paddlenlp 2.7.2 paddlepaddle-gpu 2.6.0 fast-tokenizer-python 1.0.2 fastapi 0.110.0 fastdeploy-gpu-python 0.0.0 fastdeploy-tools 0.0.5