[P0] remove autograd debugging

[aryamanarora]

Description

There was an autograd debugging line left in that significantly impacted performance. Discovered it while using a profiler to debug experiment speeds. Removing it reduced runtime for training my DAS benchmark work on pythia-14m from 289s to 170s!

Testing Done

No effect on library behaviours at all, just removed torch.autograd.set_detect_anomaly(True).

Checklist:

• [x] My PR title strictly follows the format: [Your Priority] Your Title
• [x] I have attached the testing log above
• [x] I provide enough comments to my code
• [x] I have changed documentations
• [x] I have added tests for my changes

[frankaging]

Thanks for catching this!