Not really high priority right now, but the FastICA paper suggests that the pow3 non-linearity is the fastest but also the least accurate non-linearity option, and it is the only one we have implemented. Now that our implementation of ICA is pretty stable, it might be a good project for someone to try and implement the other non-linearity functions to see if they are more accurate, and at what cost in performance.
Since inference time won't be affected by the nonlinearity, I think this is worth looking into eventually.
Not really high priority right now, but the FastICA paper suggests that the
pow3
non-linearity is the fastest but also the least accurate non-linearity option, and it is the only one we have implemented. Now that our implementation of ICA is pretty stable, it might be a good project for someone to try and implement the other non-linearity functions to see if they are more accurate, and at what cost in performance.Since inference time won't be affected by the nonlinearity, I think this is worth looking into eventually.