Open jacobbieker opened 3 years ago
PyTorch recently came out with this https://github.com/Distributed-AI/PipeTransformer that sped up training transformers and potentially using less GPU resources, or at least train faster.
PyTorch recently came out with this https://github.com/Distributed-AI/PipeTransformer that sped up training transformers and potentially using less GPU resources, or at least train faster.