Closed lhnguyen102 closed 1 month ago
@lhnguyen102 again, this is unreal π€―π. I tested on our machine and this is 2:17 for TAGI vs. 2:26 for Torch. I will let @miquelflorensa Miquel test the ResNet architecture to confirm that his issue is fixed.
Description
This PR optimize all forward and backward kernels for Linear layer for NVIDIA GPU by leveraging the shared memory and register files.
Changes Made
state_backward
andparam_backward
tobackward
function (see base_layer.cpp)Related Issue(s)
close #71
Notes for Reviewers(s)
TAGI
Pytorch