search

bytedeco / javacpp-presets

The missing Java distribution of native C++ libraries
Other
2.65k stars 738 forks source link

[nccl] could we bring nvidia nccl to javacpp pytorch? #1402

Open mullerhai opened 1 year ago

mullerhai commented 1 year ago

HI, also for pytorch distribute training and infer use multiple Nviida Gpu communite message framework, https://github.com/NVIDIA/nccl ,eagerly need it code with javacpp-pytorch,thanks

saudet commented 1 year ago

I'm pretty sure that's already enabled. Could you explain the issue you're having with it?

mullerhai commented 1 year ago

I'm pretty sure that's already enabled. Could you explain the issue you're having with it?

really,could you show me the nccl implement code in javacpp ? , and how about Nvidia apex https://github.com/NVIDIA/apex , has we already implement in javacpp

mullerhai commented 1 year ago

about nccl ,I only find the code location is here on cuda project https://github.com/bytedeco/javacpp-presets/blob/master/cuda/src/gen/java/org/bytedeco/cuda/nccl/... ,but only three little bit java file , why so small and https://github.com/bytedeco/javacpp-presets/blob/master/cuda/src/gen/java/org/bytedeco/cuda/global/nccl.java ,is all c++ version nccl function has implement ?