`AttentionBlock` forces `use_checkpoint` to be `True`, is it a feature or a bug?

openai / guided-diffusion

MIT License

6.03k stars 803 forks source link

`AttentionBlock` forces `use_checkpoint` to be `True`, is it a feature or a bug? #62

Open baofff opened 2 years ago

baofff commented 2 years ago

In Line 297 of unet.py, I find the flag argument of checkpoint(...) is set to True. This is unlike other modules, which set the flag argument to self.use_checkpoint. Is it a feature or a bug?