Predict with GPU - Githubissues

lopuhin / transformer-lm

Transformer language model (GPT-2) with sentencepiece tokenizer

164 stars 47 forks source link

Predict with GPU #7

Open binhvq opened 5 years ago

binhvq commented 5 years ago

Hi lopuhin! I'm use GPU for trainning but i can't use GPU for text generate. i'm try change device in torch but recived message RuntimeError: Expected object of backend CUDA but got backend CPU for argument 3 'index'