How to make oneccl work in this custom pytorch/ipex version?

intel / intel-xpu-backend-for-triton

OpenAI Triton backend for Intel® GPUs

MIT License

124 stars 35 forks source link

How to make oneccl work in this custom pytorch/ipex version? #1642

Closed narendrachaudhary51 closed 2 days ago

narendrachaudhary51 commented 1 month ago

This codebase requires us to install custom ipex and torch. However, I also need to install oneccl bindings for pytorch and run distributed code. (https://github.com/intel/torch-ccl)

I tried installing torch-ccl from source as mentioned in the repo. However, I got a bug in simple all reduce code. How do you use torch-ccl with your custom pytorch/ipex?

error_log.txt

vlad-penkin commented 1 month ago

@narendrachaudhary51 we are switching to the upstream PyTorch. The ETA for completion is next two weeks. In the meantime you try to build upstream pytorch from the top of main trunk.