[Org Carbon Footprint As a Data Product] - Visualise and track Organisation Carbon Footprint so that org can take better decisions to maintain sustainable environment

ramgsuri commented 5 months ago

Prize Category

Best Plugin

Overview

Creating an organisation's carbon footprint as a data product involves collecting, analyzing, and presenting data related to the organisation's environmental impact with the help of Visualization & Dashboard. For MVP we have started with visualizations as an output in the form of html, hence named it as visualization-plugin. The output of this plugin are visualizations in the form of html file which can present key metrics and insights related to the organization's carbon footprint. Following steps are involved in building this Data Product :

Data Collection:

Gather data from various application sources within the organisation, such as energy consumption by CPUs, carbon emitted by Cloud Servers. Uses mock-observations plugin to consume data as its input.

Data Processing and Analysis:

Clean and preprocess the collected data to ensure consistency and accuracy. Calculate carbon emissions for each data source using established methodologies and emission factors. Invokes cloud-metadata, teads-curve, watttime plugin and operational-carbon plugin to produce the operational carbon footprint for the servers.

Visualization and Reporting:

Developed interactive dashboards and visualizations to present key metrics and insights related to the organization's carbon footprint and produced html file as an output product from the plugin so that stakeholders can unlock insights from data. Use charts, graphs, maps, and other visual elements to communicate complex data in a clear and intuitive manner. Create customized reports and presentations for different stakeholders, such as executives, sustainability teams, investors, and regulators.

Use feedback loops to gather input from stakeholders and incorporate suggestions for improvement.

Impact : By treating the organization's carbon footprint as a data product, we can provide stakeholders with valuable insights into environmental performance, drive positive change, and demonstrate a commitment to sustainability and corporate responsibility.

Questions to be answered

No response

Have you got a project team yet?

Yes and we are not recruiting

Project team

Team Name : Datamusers Team Members :
@ramgsuri @Aditya-Amgaonkar
@ravinderj @vanshkapoor

Terms of Participation

[X] I agree to the hackathon Rules & Terms and Code of Conduct

Project Submission

Summary

Visualisation Plugin seamlessly integrates into the pipeline to understand insights around carbon emissions and CPU consumption of an organization servers and returns a report with detailed comparison visualisations for the list of your servers over the time range. As of now, our report provides analysis on 2 Parameters i.e, CPU consumption and Carbon emissions by your servers.

Through these reports, stakeholders can analyse and track how much carbon and cpu consumption is happening on timely basis and can take further steps. These reports can act as a goto report to understand servers emissions and utilizations and stakeholders can take appropriate actions and business decisions

Problem

It is very hard to take decision from raw data presented in tabular format. If business needs to unlock insights from data then visualisations can help the stakeholders to take appropriate business decision. Hence with the help of visualization-pluginn now stakeholders can plug the plugin into the pipeline and using Impact Engine they can produce visualization as data product output which help them to unlock insights from data and track carbon emissions of an organisation so that they can take appropriate actions and business decisions accordingly.

Application

Visualisation Plugin comprised of Input and Outputs. Plugin seamlessly integrates in the pipeline to understand insights around carbon emissions and CPU consumption of an organization’s server data and returns a report with detailed comparison visualisations for the list of your servers over the time range. As of now, our report provides analysis on 2 Parameters i.e, CPU consumption and Carbon emissions by your servers.

Prize category

Best Plugin

Judging Criteria Overall Impact 👩🏽‍⚖️ By Integrating this plugin into the pipeline now stakeholders can unlock insights from data and visualize the graphs and take appropriate actions to reduce carbon emissions.

Opportunity Opportunity to unlock insights from data and present visuals as output so that stakeholders can take better decisions from organisation's standpoint.

Modularity The Code is modular can easily be integrated with current existing IF official and un official plugins. Modular Architecture and follows Single Responsibility Principle. Devops integrated as CI/CD is enabled via Github actions.

Process

We took the clone of IF repo and then leveraged the copy-plugin example to start the plugin and go through the codebase. This has helped us to start simple and integrate CI/CD in the repository in the beginning to keep the process devops enabled and Agile. We then started to run the standalone plugin and do an integration in the current framework, once E2E is done, then we started adding the code and functionality to plugin and enrich the config and inputs and started consuming in code.

Inspiration

The Simplicity of the IF Framework and the sense of responsibility towards environment and sustainable living inspired us to contribute and take some time out of the daily work and chores and learn about Green Software Foundation Course and start contributing and start hands-on with IF codebase.

Challenges

The challenge we faced when we started integrating the existing plugins and leverage the inputs of the previous pipelines and as we were producing visualizations as output so we wanted to make sure that our plugin can be used in the middle of the pipeline as well and not just in the end as the end output of our plugin is html visualizations.

Accomplishments

We were able to integrate the plugin in the current IF codebase and were also able to leverage the current existing plugins into our work and integrate CI/CD into the development work as well.

Learnings

Learn about Impact Framework, new terminologies around developing Green Software and making the environment sustainable for all.

What's next?

To scale the solution and the amount of data we plan to leverage LLMs in our data and train the model so that solution can Incorporate storytelling techniques to highlight successes, challenges, and opportunities for reducing carbon emissions. Continuous Monitoring and Improvement will help organisation to keep track of their OKRs towards Carbon Footprint Set targets and goals for reducing carbon emissions and track progress over time.

updownip commented 5 months ago

@ramgsuri lovely idea.

usmanzafar commented 5 months ago

@ramgsuri like the idea, keen to participate

Mercy-Iyanu commented 5 months ago

Hi @ramgsuri I think this is an awesome project to work on! Are you still looking for members? I'd love to contribute.

brandonsmith86 commented 4 months ago

@ramgsuri This is sorely needed. I'd love to join the project.

ritusanthoshgn commented 4 months ago

@ramgsuri Interested. Would like to contribute.

Sophietn commented 4 months ago

Hi @ramgsuri There's quite a bit of interest from potential participants above! Are you looking for additional team participants? Would you like to attend our Launch event on the 18th March 2.30pm GMT, to discuss your project idea and attract team members?

usmanzafar commented 4 months ago

This is an awesome idea, keen to contribute

pchan2 commented 4 months ago

Hello, are you looking for additional members as I am looking for a team to join. 2-3 years experience in software eng, polyglot (JS, C#, Java, Python). Thanks

rachanakabi commented 4 months ago

Hello, I have experience in React JS, Azure Data Factory and Azure Rest APIs. I also have experience in Data Architecture, Data Modelling. Would like to take the job. Regards

Aide-C commented 4 months ago

Hello, @ramgsuri this project sounds amazing and I would love to join your team if you are still looking. I have coding experience in python, c++, javascript, and bit of java (need a refresher).

ramgsuri commented 4 months ago

@ramgsuri like the idea, keen to participate

Sure feel free to contribute. we can connect.

ramgsuri commented 4 months ago

Hello, @ramgsuri this project sounds amazing and I would love to join your team if you are still looking. I have coding experience in python, c++, javascript, and bit of java (need a refresher).

Sure good to hear that. let's connect.

ramgsuri commented 4 months ago

Hi @ramgsuri There's quite a bit of interest from potential participants above! Are you looking for additional team participants? Would you like to attend our Launch event on the 18th March 2.30pm GMT, to discuss your project idea and attract team members?

Sure happy to talk about my idea and spread awareness to the community.

NithishGajula commented 4 months ago

@ramgsuri That's really a great idea, would love to contribute here

Sophietn commented 4 months ago

@ramgsuri Great news. Thank you. Please attend our next Livestream on 25th March 2.30pm - register here - there will be an opportunity for hack project leads to take a segment to discuss their idea and attract participants if necessary

Aide-C commented 4 months ago

Hello, @ramgsuri this project sounds amazing and I would love to join your team if you are still looking. I have coding experience in python, c++, javascript, and bit of java (need a refresher).

Sure good to hear that. let's connect.

What is better communication for you @ramgsuri, email or notification on Git Hub?

ramgsuri commented 4 months ago

@ramgsuri That's really a great idea, would love to contribute here

Thanks @NithishGajula for showing your interest, will add you in the team members list.

ramgsuri commented 4 months ago

Hi @ramgsuri I think this is an awesome project to work on! Are you still looking for members? I'd love to contribute.

Thanks will add you in my team members list.

ramgsuri commented 4 months ago

Hello, @ramgsuri this project sounds amazing and I would love to join your team if you are still looking. I have coding experience in python, c++, javascript, and bit of java (need a refresher).

Sure good to hear that. let's connect.

What is better communication for you @ramgsuri, email or notification on Git Hub?

would prefer email then notification on github.

ramgsuri commented 4 months ago

Hi @ramgsuri I think this is an awesome project to work on! Are you still looking for members? I'd love to contribute.

Thanks @Mercy-Iyanu for showing interest, added you in the team members list, lets connect.

Aide-C commented 4 months ago

Hello, @ramgsuri this project sounds amazing and I would love to join your team if you are still looking. I have coding experience in python, c++, javascript, and bit of java (need a refresher).

Sure good to hear that. let's connect.

What is better communication for you @ramgsuri, email or notification on Git Hub?

would prefer email then notification on github.

My business email is a_c1570@txstate.edu

ramgsuri commented 4 months ago

@russelltrow can you please help me removing the recruiting tag as we have our team created.

ramgsuri commented 3 months ago