test implementation using megatron gpt2 medium and bert-based formality ranker - Githubissues

t0d4 / informal-gpt

GPT-2 model finetuned to talk in informal way

0 stars 0 forks source link

test implementation using megatron gpt2 medium and bert-based formality ranker #2

Closed t0d4 closed 1 year ago

t0d4 commented 1 year ago

最初のトライとして、

Reward Modelに s-nlp/roberta-base-formality-ranker
Text Generatorに robowaifudev/megatron-gpt2-345m

を使ってRLしてみる。