search

artyom-beilis / pytorch_dlprim

DLPrimitives/OpenCL out of tree backend for pytorch
http://blog.dlprimitives.org/
MIT License
276 stars 17 forks source link

LLM support #53

Open huizhanyi opened 8 months ago

huizhanyi commented 8 months ago

Can any plan to support LLM, what commubication library can be used with OpenCL?

artyom-beilis commented 8 months ago

I'm not familiar too much with LLM.

What operators are missing?

huizhanyi commented 8 months ago

I want to know if support parallel trainning, and which communication library can be used. I find NCCL / RCCL cannot work with opencl.