uber-research / PPLM

Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
Apache License 2.0
1.13k stars 202 forks source link

Story generation with skeleton? #14

Closed strwberry-smggls closed 4 years ago

strwberry-smggls commented 4 years ago

Hi there!

This is quite an interesting project and I've been experimenting a lot with different setups, generating theater plays and other more unconventional pieces of text. I have a question about the small story-writing part of the paper. The results looked very interesting and I wanted to try it on my own. Basically, what kind of input do you give to the language model when you "fill in the blanks" between the story skeleton? Do you generate text then feed the skeleton piece, then generate text again ect. or did you come up with a different approach?

Best wishes, Lukas

dathath commented 4 years ago

Hello Lukas,

Sorry for the delay in responding. We did the former i.e, "generate text then feed the skeleton piece, then generate text again", and the story skeleton is from here.