PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
12.17k stars 2.94k forks source link

[Bug]: pyspark不能加载uie的模型包 #5915

Open guiniao opened 1 year ago

guiniao commented 1 year ago

请提出你的问题

使用uie模型提取文本的维度,关键词以及对应的情感倾向,利用pyspark在集群上做推理的定时任务,使用senta = Taskflow("sentiment_analysis",model="uie-senta-base", schema=schema,task_path="./model_best")加载模型,报错,好像是不能序列化模型,报错如下:_pickle.PicklingError: Could not serialize object: TypeError: can't pickle paddle.fluid.libpaddle.AnalysisConfig objects,有人遇到过这个情况吗,怎么处理

w5688414 commented 6 months ago

UIE已经停止更新了,欢迎开发者贡献哈