Cannot use torch.compile with SAT

THUDM / SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

https://THUDM.github.io/SwissArmyTransformer

Apache License 2.0

978 stars 92 forks source link

Cannot use torch.compile with SAT #141

Open lijing1996 opened 12 months ago

lijing1996 commented 12 months ago

I tried to use torch.compile but failed with SAT. The reason is that self.transformer.hooks.clear() in base_model.py also clear the hooks of torch.compile?