search

salesforce / ctrl

Conditional Transformer Language Model for Controllable Generation
https://arxiv.org/abs/1909.05858
BSD 3-Clause "New" or "Revised" License
1.87k stars 208 forks source link

Using ctrl for summarization #64

Closed Hellisotherpeople closed 4 years ago

Hellisotherpeople commented 4 years ago

I can get a abstractive summary using GPT-2 by taking a prompt, appending "TL;DR" to the end, and letting it generate.

Does CTRL have a better method for this based on control codes? I saw nothing obvious about it in the paper.

keskarnitish commented 4 years ago

IIRC, you should use the News CTRL code and TL;DR as the triggering token.

shamoons commented 4 years ago

Can you give an example of what that prompt would look like?