PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.72k stars 2.86k forks source link

[Question]: uie Taskflow 推理和use_paddle_infer_backend 推理占用的显存不一样 #8563

Open BeginningOne opened 3 weeks ago

BeginningOne commented 3 weeks ago

请提出你的问题

Taskflow 在服务器上推理占用显存是700多M
use_paddle_infer_backend 是2400M 屏幕截图 2024-06-06 183554 使用 use_paddle_infer_backend 会占用更大的资源吗?