search

PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.97k stars 2.91k forks source link

请问paddlenlp 有没有非自回归的语言模型 #3508

Closed dlkht closed 1 year ago

dlkht commented 1 year ago

请提出你的问题

比如做到并行解码的

wawltor commented 1 year ago

能列举一下想要的模型吗？

dlkht commented 1 year ago

能列举一下想要的模型吗？

比如论文 ACL2021 "Glancing Transformer for Non-Autoregressive Neural Machine Translation"实现的模型

wawltor commented 1 year ago

Non-Autoregressive

目前在机器模型翻译的模型中我们目前还没有Non-Autoregressive的模型，目前还是依赖于token by token，不过目前这种模型整体而言效果还是比 Non-Autoregressive 效果好点

guoshengCS commented 1 year ago

如果是说觉得自回归速度慢希望更快的生成的话，PaddleNLP针对GPU环境是有预测加速支持的可以试下

github-actions[bot] commented 1 year ago

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动，被标记为stale。

github-actions[bot] commented 1 year ago

This issue was closed because it has been inactive for 14 days since being marked as stale. 当前issue 被标记为stale已有14天，即将关闭。