Currently, when using DAS with upstream interventions, gradient may throw arrow. This is due to some side-effect issues. We fix this by always-clone the passing activations in hook calls.
Testing Done
----------------------------------------------------------------------
Ran 49 tests in 43.641s
OK
Checklist:
[x] My PR title strictly follows the format: [Your Priority] Your Title
📝 Description
Currently, when using DAS with upstream interventions, gradient may throw arrow. This is due to some side-effect issues. We fix this by always-clone the passing activations in hook calls.
Testing Done
Checklist:
[Your Priority] Your Title