search

PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.96k stars 2.91k forks source link

[Docs]: #6903

Open zhjc opened 1 year ago

zhjc commented 1 year ago

软件环境

- paddlepaddle:
- paddlepaddle-gpu: develop最新
- paddlenlp: develop最新

详细描述

llm/README.md文档：
4.2 静态图推理 章节

不支持加--inference_model导出模型，无法导出支持动态batch的模型
w5688414 commented 4 months ago

现在支持了，重新升级试一下，或者提供一下paddle和paddlenlp的版本