search

bytedance / lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation
Other
3.16k stars 328 forks source link

你好，当bert 采用 UNILM 方案做文本生成的时候 ，请问lightseq可以提供 beamsearch的加速功能嘛？ #232

Open zcuuu opened 2 years ago

neopro12 commented 2 years ago

Currently not supported. The search module and decoder are coupled together now and we are developing a separate search module. Expected to take one month

zcuuu commented 2 years ago

thank u

zhanghaoie commented 2 years ago

Hi, 请问你使用light seq对unilm加速了吗？效果怎么样啊？

zcuuu commented 2 years ago

halo，我只是了解到这个方案，并没有去实践，非常抱歉