search

openai / finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
MIT License
2.14k stars 499 forks source link

Language Model Generation Example #1

Closed aykutfirat closed 6 years ago

aykutfirat commented 6 years ago

This is very exciting work! Can you provide the steps to generate a language model using your architecture?

Thanks.

Newmu commented 6 years ago

Hi @aykutfirat,

This current release is focused on supervised fine-tuning of the language model. In the next month or so we will be releasing some followup work discussing the generative behaviors of the model and likely include this code in that release.

ncammarata commented 6 years ago

@Newmu any update in ETA? I'd love to build an interface for it to explore some of its properties more!

madisonmay commented 6 years ago

@ncammarata we have an interface for text generation using this language model up at https://github.com/IndicoDataSolutions/finetune.

Example usage is at: https://github.com/IndicoDataSolutions/finetune/blob/master/tests/test_classifier.py#L167

ncammarata commented 6 years ago

@madisonmay super cool thanks!