Closed SingletC closed 1 year ago
Hi @SingletC, currently second derivatives are not supported with this library. Since it is written as a C++, CUDA extension, pytorch does not support "Double Backwards" (see when backward is not tracked. One could write a custom backward function for the existing backward function to enable higher order derivatives, but this could be quite difficult and would not have the bandwidth to work on this. I believe you would have the same issue with the original code base as the operations are written in plain numpy, but there may be some other solutions in the recent years if you look around.
Hi, I appreciate the author shared this torch version of softsort. I have some applications that require calculate the hessian matrix. I run into the problem of doing so. here is the minimum code that reproduces the error.
I will got
Then I try softsort
I got
Here are my packages' version:
I appreciate any thoughts to confirm this is an issue with Torchsort or I did something wrong