search

microsoft / knossos-ksc

Compiler with automatic differentiation
Other
45 stars 10 forks source link

Implement vsqrl #966

Closed toelli-msft closed 3 years ago

toelli-msft commented 3 years ago

@awf @cgravill: I get the impression that sqrl is like "pooling operation" so we want vsqrl that takes a tensor of size 4mx4n and applies sqrl to 4x4 subtensors (with a stride of 4x4). Is that right?

https://github.com/microsoft/knossos-ksc/blob/88e1491849f10893cb97e04281835477d6a19c9b/examples/dl-capsule/sqrl.py#L5-L17

awf commented 3 years ago

That's right -- I am planning for vmap to cover that case

toelli-msft commented 3 years ago

Closing in favour of https://msrcambridge.visualstudio.com/Knossos/_workitems/edit/20398

awf commented 3 years ago

closed by #1019