using gpu device - Githubissues

summerstay / true_poetry

Poetry generator by gpt-2 with meter and rhyme constraints.

53 stars 9 forks source link

Open Hagasus opened 2 years ago

Hagasus commented 2 years ago

is it possible to use a gpu device for next token prediction. should be far faster. tried to implement it myself, but got stuck.