rahulvigneswaran / Lottery-Ticket-Hypothesis-in-Pytorch

This repository contains a Pytorch implementation of the paper "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks" by Jonathan Frankle and Michael Carbin that can be easily adapted to any model/dataset.
325 stars 91 forks source link

Does it give inference speed/memory usage improvement? #23

Open ajktym94 opened 2 years ago

ajktym94 commented 2 years ago

If this is used for Lottery Ticket Hypothesis experiments on a model, will it result in improvement in terms of inference speed/memory usage of the models?

As far as I know, even if the models are pruned, they would use the same memory as earlier and hence would take the time and memory as before.