Closed jaywonchung closed 5 months ago
Or I think having a new subsection (17.XX) dedicated for energy optimization would make sense, since I believe that ultimately one of the important goals of MLSys is to optimize energy consumption, going beyond estimation and reporting.
Hi @jaywonchung that's a great point, thanks for raising that. Please definitely go ahead and add a paragraph and in general it would be great to talk about the space broadly and of course we can include a reference to the point that Zeus is making.
Can you please draft what you have in mind and issue a PR? Would be happy to review it and make any edits and merge it in.
If you are interested, then create a branch off of this PR.
First of all, thanks for the great resource.
I'm part of a group of people working on ML energy optimization at UMich (https://ml.energy). To list a couple works:
Training
Inference
Chapter 17.3 Energy Consumption does a very nice survey on efforts for energy estimation, measurement, and reporting. I'm thinking of adding a paragraph on energy optimization. Please let me know what you think.