Is that a way to do "general" generation?

salesforce / ctrl

Conditional Transformer Language Model for Controllable Generation

https://arxiv.org/abs/1909.05858

BSD 3-Clause "New" or "Revised" License

1.87k stars 208 forks source link

Is that a way to do "general" generation? #66

Closed cloudygoose closed 4 years ago

cloudygoose commented 4 years ago

Hi, thanks for everything.

The control codes are great. I'm just wondering is there a way to do general generation, like the gpt model? Or what could be the control code that's nearest to the general case?

keskarnitish commented 4 years ago

The Links control code is essentially the same as what GPT2 trained on. You can use that.