search

ucbrise / actnn

ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
MIT License
196 stars 30 forks source link

[Feature] Add QDropout #18

Closed cenyk1230 closed 3 years ago

cenyk1230 commented 3 years ago

Hi, I have implemented a version of QDropout (Issue #17 ) based on QReLU.

merrymercy commented 3 years ago

Thanks for the contribution! An additional task: support QDropout in the model converter https://github.com/ucbrise/actnn/blob/711b750af56ffd4cc5276cea3d7880fc5de211b1/actnn/actnn/module.py#L65-L66