Predict with GPU

[binhvq]

Hi lopuhin!
I'm use GPU for trainning but i can't use GPU for text generate. i'm try change device in torch but recived message RuntimeError: Expected object of backend CUDA but got backend CPU for argument 3 'index'