lucasdelimanogueira / PyNorch

Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
117 stars 7 forks source link

fix broadcast and reduce gradients distributeddataparallel and tensor… #84

Closed lucasdelimanogueira closed 6 months ago

lucasdelimanogueira commented 6 months ago

… hooks