harvard-edge / cs249r_book

Collaborative book Machine Learning Systems
https://harvard-edge.github.io/cs249r_book/
Other
574 stars 104 forks source link

Suggestion: Cite the following papers #304

Closed FinAminToastCrunch closed 23 hours ago

FinAminToastCrunch commented 1 week ago

In reference to Ethical Considerations on Pruning, I would suggest citing:

Tran, Cuong, et al. "Pruning has a disparate impact on model accuracy." Advances in neural information processing systems 35 (2022): 17652-17664.

As it discusses how pruning can harm accuracy with respect to inferencing on certain ethnicities.

In reference to Establishing Criteria for Pruning, I believe these two papers would be relevant to cite for the portions on importance scores as they tie together more recent work concerning gradient flow and neuron magnitude:

J. Rachwan, D. Z ̈ugner, B. Charpentier, S. Geisler, M. Ayle, and S. G ̈unnemann, “Winning the lottery ahead of time: Efficient early network pruning,” in International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA (K. Chaudhuri, S. Jegelka, L. Song, C. Szepesv ́ari, G. Niu, and S. Sabato, eds.), vol. 162 of Proceedings of Machine Learning Research, pp. 18293– 18309, PMLR, 2022.

E. S. Lubana and R. P. Dick, “A gradient flow framework for analyzing network pruning,” CoRR, vol. abs/2009.11839, 2020.

profvjreddi commented 5 days ago

@FinAminToastCrunch The link you shared is not working. Could you update the link so I can take at which part you are referring to here.

FinAminToastCrunch commented 4 days ago

Fixed:

https://harvard-edge.github.io/cs249r_book/contents/optimizations/optimizations.html#legal-and-ethical-considerations

profvjreddi commented 4 days ago

Thanks Fin! Do you think you could issue a PR so that I could review it and merge it in? I will edit it if needed after you issue a PR.

On Thu, Jul 04, 2024 at 12:32 PM, Fin Amin @.***> wrote:

Fixed:

https://harvard-edge.github.io/cs249r_book/contents/optimizations/ optimizations.html#legal-and-ethical-considerations

— Reply to this email directly, view it on GitHub https://github.com/harvard-edge/cs249r_book/issues/304#issuecomment-2209323852, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABT6DFCX5CGCGD27HY2FEBLZKV2K7AVCNFSM6AAAAABKGWEZOSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBZGMZDGOBVGI . You are receiving this because you commented.Message ID: @.***>

profvjreddi commented 4 days ago

And just as FYI. I typically avoid incorporating overly cutting-edge material into the book. The criterion for inclusion is that the industry must be actively adopting and utilizing the methods discussed. This approach ensures the content remains relevant and avoids delving into an excessive number of rapidly evolving topics. Does that make sense?

On Thu, Jul 04, 2024 at 12:44 PM, Janapa Reddi, Vijay @.***> wrote:

Thanks Fin! Do you think you could issue a PR so that I could review it and merge it in? I will edit it if needed after you issue a PR.

Vijay Janapa Reddi, Ph. D. | John L. Loeb Associate Professor of Engineering and Applied Sciences | John A. Paulson School of Engineering and Applied Sciences | Science and Engineering Complex (SEC) | 150 Western Ave, Room #5.305 | Boston, MA 02134 | Harvard University | My Website http://scholar.harvard.edu/vijay-janapa-reddi | Google Scholar https://scholar.google.com/citations?hl=en&user=gy4UVGcAAAAJ&view_op=list_works&sortby=pubdate | Edge Computing Lab https://edge.seas.harvard.edu | Book Meeting https://fantastical.app/vjreddi/ | Contact Admin https://scholar.harvard.edu/vijay-janapa-reddi/contact |

On Thu, Jul 04, 2024 at 12:32 PM, Fin Amin @.***> wrote:

Fixed:

https://harvard-edge.github.io/cs249r_book/contents/optimizations/ optimizations.html#legal-and-ethical-considerations

— Reply to this email directly, view it on GitHub https://github.com/harvard-edge/cs249r_book/issues/304#issuecomment-2209323852, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABT6DFCX5CGCGD27HY2FEBLZKV2K7AVCNFSM6AAAAABKGWEZOSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBZGMZDGOBVGI . You are receiving this because you commented.Message ID: @.***>

FinAminToastCrunch commented 4 days ago

Done!

And yes, makes sense.

profvjreddi commented 19 hours ago

Dealt with in issue https://github.com/harvard-edge/cs249r_book/pull/306 and PR