Some fixes and improvements regarding to element-wise operations

slimgroup / InvertibleNetworks.jl

A Julia framework for invertible neural networks

MIT License

149 stars 21 forks source link

Some fixes and improvements regarding to element-wise operations #14

Closed alisiahkoohi closed 3 years ago

alisiahkoohi commented 3 years ago

Mainly, the current changes are related to src/utils/activation_functions.jl where the element-wise operations are replaced. In addition, I changed the way we were inputting dims argument (tuple) for several operations, such as sum, mean, and var since CUDA.jl required an array rather than tuple. There was one small fix in the 3D ResidualBlock in line 166

mloubout commented 3 years ago

Looks good to me, I guess needs the conv1x1 fix and should be gtg