[Action to craft a Project Proposal] Benchmarking Whitepaper

leonardpahlke commented 10 months ago

^{This is a tracking issue for the action item proposed and accepted for the TAG ENV 2024 roadmap see https://github.com/cncf/tag-env-sustainability/issues/321. Proposed originally here.}

Project proposal summary: Write a whitepaper. Conduct benchmarking and diving into deployment efficiency, including metrics like image size, build times, memory consumption, server density, performance and network.

Next steps:

[ ] Project proposal https://github.com/cncf/tag-env-sustainability/issues/new?assignees=&labels=triage-required&projects=&template=project-suggestion.md&title=%5BPROEJCT+PROPOSAL+%2F+SUGGESTION%5D+some+descriptive+title - used to discuss the project, find additional collaborators and have a tracking issue for the project.
[ ] Have one or more leads for the project to report about the progress every other week.
[ ] Details added to the TAG ENV website (new page next to working groups)
[ ] Project details announced

@ArneTR @felipehuici - as authors, it would be great if you could follow the steps described above to start the project. If not, please comment below, in which case the project will likely be canceled. If you need support, comment below or get in touch via Slack. Thank you very much!

cc @mkorbi @catblade

catblade commented 10 months ago

Please keep me on this

leonardpahlke commented 9 months ago

We just added two new GitHub issue templates to propose and track projects. The proposal topic is used to define and discuss the project details. The tracking output is used to track the ongoing progress until the project is completed. I linked the proposal issue in the todo items of this issue. After this issue is completed, we can open the tracking issue and start working on the project. I hope this helps.

leonardpahlke commented 9 months ago

I dont know who will take the lead here. We might close this issue to start a project around benchmarking in a week or two if there is no traffic.

ArneTR commented 9 months ago

Hey @leonardpahlke

as said in https://github.com/cncf/tag-env-sustainability/discussions/273 we are up for making some measurements.

I do not quite understand the Whitepaper though. The measurements with our tooling will already contain the measurements in a linkable and presentable fashion on the https://metrics.green-coding.io dashboard.

The metrics can of course also be extracted, but maybe it is sufficient and easier to just link it?

If I misunderstood the idea of this task am very grateful for some more details.

catblade commented 4 months ago

@ArneTR it's so that someone has a place to read the content without following a mountain of links. An example, a how-to-use, with pictures can really speed up someone trying to do similar.

ArneTR commented 4 months ago

@catblade I thought I be throurough and provide many links, but I see now that this is apparently more overwhelming than helpful :)

I think the best case would be if we setup a new case that is more familiar to the CNCF folks. I could make a step-by-step tutorial and also something like a diagram to showcase how the components of the measurement tool and the software interact.

What would be helpful is some pointers from you which CNCF project I should pick to create such a case. It is very beneficialy it if is a quite self-contained project that also runs in a local-like setup (Docker containers, MiniKube, k3s local etc.)

Does that sound helpful?

cncf / tag-env-sustainability

[Action to craft a Project Proposal] Benchmarking Whitepaper #327