The element-wise operations are performed on the last dimension on a given index. It assumes that tensors are stacked row-wise but that their dimension is increased in the next dimension on the tensor.
For example take 3 stacked 2x2 tensors, which have dimension 2x2x3
[a, a]
[a, a]
[b, b]
[b, b]
[c, c]
[c, c]
The elementwise operation with index 0 will perform operations on a, index 1 on b, index 2 on c. Currently only logistic and tanh are implemented, but other elementwise operations can be added easily.
See the test in the test_handler_operations for examples.
The element-wise operations are performed on the last dimension on a given index. It assumes that tensors are stacked row-wise but that their dimension is increased in the next dimension on the tensor.
For example take 3 stacked 2x2 tensors, which have dimension 2x2x3 [a, a] [a, a] [b, b] [b, b] [c, c] [c, c]
The elementwise operation with index 0 will perform operations on a, index 1 on b, index 2 on c. Currently only logistic and tanh are implemented, but other elementwise operations can be added easily.
See the test in the test_handler_operations for examples.