Open jianc99 opened 1 month ago
Mutated arguments have be annotated: https://pytorch.org/tutorials/advanced/cpp_custom_ops.html#creating-mutable-operators
I noticed that you already annotated the mutated inputs.
I think it's okay to expose another set of apply_rope
and apply_llama31_rope
which are not inplace operations for pytorch compile.
Yeah I have annotated that but it still not works. Exposing non in place rope will be much helpful, thanks!
Done in #405 .