"Warp uses a source-code transformation approach to auto-differentiation."
I don't quite understand what this means and I know this is not how one is supposed to use tape but my question is: Is it technically possible for me to write a @wp.func foo and get back a @wp.func foo_derivative which I can save and reuse later within kernel launches? This is in contrast to doing it at the kernel level.
Currently we don't provide a way to call the derivative directly - however this would not be too difficult and I can imagine could be quite useful. I will make a note of this feature request.
"Warp uses a source-code transformation approach to auto-differentiation."
I don't quite understand what this means and I know this is not how one is supposed to use tape but my question is: Is it technically possible for me to write a
@wp.func foo
and get back a@wp.func foo_derivative
which I can save and reuse later within kernel launches? This is in contrast to doing it at the kernel level.