hikettei / cl-waffe2

[Experimental] Graph and Tensor Abstraction for Deep Learning all in Common Lisp
https://hikettei.github.io/cl-waffe2/
MIT License
122 stars 5 forks source link

2x Times Faster Training by various optimizations #121

Closed hikettei closed 9 months ago

hikettei commented 9 months ago

Changes

!move/!copy ... :maybe-in-place

CL-WAFFE2-REPL> (disassemble-waffe2-ir (!sin (!sin (randn `(3 3)))))

disassemble-waffe2-ir:
 [Forward]: 
<WfInst[op=ALLOC{INTERNAL}]   : TID40883 <= op(TID40883{float, (3 3)} <Input>TID40880{float, (3 3)})>
<WfInst[op=SINNODE-CPUTENSOR] : TID40883 <= op(<Input>TID40880{float, (3 3)} TID40883{float, (3 3)})>
<WfInst[op=SINNODE-CPUTENSOR] : TID40883 <= op(TID40883{float, (3 3)} TID40883{float, (3 3)})>

3 Instructions | 2 Tensors | 0 Scalars

 [Pullback]: 

0 Instructions | 0 Tensors | 0 Scalars

BugFix: Shape-Error

call-with-view