dapascual
commented
2 years ago Hi! The initial context is determined by 'in_text', which is defined in main.py in line 660 for writing articles (like in the example you point at), and in line 664 for any other case. In line 664, the initial context is set to '<|endoftext|>', which corresponds to the beginning of sequence token, i.e., no context is given. If you want to provide initial context you just need to modify the value of in_text.
I hope this helps, please let me know if you have any further questions.
Best
Hi thank you for great work,
I have a question on how to generate with context sentence as input of your model as you did in your paper appendix.
For example:
Text 1
Context: Johnny Depp will be asked to make a fifth Pirates Of The Caribbean film if the fourth instalment is a success. Producer Jerry Bruckheimer said he already has a screenplay
Keywords: fifth, audience, embraces, character, original, trilogy, continue, story, digital, cameras, pirates, fresh, new, carry
OURS + GPT2-774M: Johnny Depp will be asked to make a fifth Pirates Of The Caribbean film if the fourth instalment is a success. Producer Jerry Bruckheimer said he already has a screenplay with Pirates new trilogy character Johnny Depp and digital animation studio Story Studio. The fifth film will continue the original story from the first three films and will be set in the Caribbean. "We are very excited to carry on the story of the audience’s favourite Pirates of the Caribbean characters," said Bruckheimer. "We are fresh off the success of Pirates of the Caribbean: On Stranger Tides and we are looking forward to embracing the new generation of fans with a new film that will be even more exciting than the first three films." The Pirates of the Caribbean: On Stranger Tides cameras have been filming in Barranquilla since April 11. Filming will continue for two months to reach completion by May 23
Thank you again for your great work!