PaddlePaddle / Paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)
http://www.paddlepaddle.org/
Apache License 2.0
22.13k stars 5.56k forks source link

【论文复现】PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization #35042

Closed myboyliu closed 3 years ago

myboyliu commented 3 years ago

在复现标题论文时候,能把vocab和权重先放到: https://paddlenlp.bj.bcebos.com/models/transformers

paddle-bot-old[bot] commented 3 years ago

您好,我们已经收到了您的问题,会安排技术人员尽快解答您的问题,请耐心等待。请您再次检查是否提供了清晰的问题描述、复现代码、环境&版本、报错信息等。同时,您也可以通过查看官网API文档常见问题历史IssueAI社区来寻求解答。祝您生活愉快~

Hi! We've received your issue and please be patient to get responded. We will arrange technicians to answer your questions as soon as possible. Please make sure that you have posted enough message to demo your request. You may also check out the APIFAQGithub Issue and AI community to get the answer.Have a nice day!

myboyliu commented 3 years ago

验收标准: 1. 复现PEGASUS模型(参考论文和实现链接)

  1. 完成模型权重从pytorch到paddle的转换代码,转换2个预训练权重(“google/pegasus-large”, “tuner007/pegasus_paraphrase”,“google/pegasus-xsum”,“google/pegasus-cnn_dailymail”)

    写的是2个,可是列了4个权重名称,到底是哪2个?

yingyibiao commented 3 years ago

验收标准: 1. 复现PEGASUS模型(参考论文和实现链接)

  1. 完成模型权重从pytorch到paddle的转换代码,转换2个预训练权重(“google/pegasus-large”, “tuner007/pegasus_paraphrase”,“google/pegasus-xsum”,“google/pegasus-cnn_dailymail”) 写的是2个,可是列了4个权重名称,到底是哪2个?

这里写错了,是要求4个权重

yingyibiao commented 3 years ago

在复现标题论文时候,能把vocab和权重先放到: https://paddlenlp.bj.bcebos.com/models/transformers

在通过验收之前,暂时不支持。