Open zougloub opened 1 year ago
It is likely one of operators not implemented yet.
Hand't get into NLP area yet. From what I remember embedding is some initital lightweight stage and usually is not backpropogated? Am I right?
Can you try to run this part on CPU?
I can run it on CPU, yeah.
index_select
is a conceptually "easy" operation but implementing it efficiently is not (cf. aten/src/ATen/native/cuda/Indexing.cu / index_select_out_cuda_impl()
).
index_select is a conceptually "easy" operation but implementing it efficiently is not (cf. aten/src/ATen/native/cuda/Indexing.cu / index_select_out_cuda_impl()).
I'll take a look on it.
Can you get simple example of how do you use it - I just not that familiar with it yet :-)
Can
Every now and then, I'm checking https://github.com/pytorch/pytorch/issues/488, usually in despair.
But then I saw @artyom-beilis's pytorch_dlprim, which is hooking into the privateuseone backend to FINALLY provide support of generic OpenCL hardware.
As I was trying it out on a model, I got this error: