[Feature] QDropout Implementation

ucbrise / actnn

ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training

MIT License

196 stars 30 forks source link

[Feature] QDropout Implementation #17

Closed cenyk1230 closed 3 years ago

cenyk1230 commented 3 years ago

Thanks for the great work. I find that it doesn't give the implementation of QDropout, which is a common operator in NNs. I have implemented a version of QDropout based on the QReLU, could I submit my implementation via pull requests?