Closed weiyanlin117 closed 1 year ago
implement GEMM backward with original MPS
h = g @ w.T dw = a.T @ g bias = g reduce on target axis.
10 tests original from cublas.tests.c all passed.
implement GEMM backward with original MPS
h = g @ w.T dw = a.T @ g bias = g reduce on target axis.
10 tests original from cublas.tests.c all passed.![Screenshot 2023-08-08 at 9 46 59 PM](https://github.com/liuliu/ccv/assets/18563592/52d5e837-82d2-4902-8024-0355052cd69a)