Green-Software-Foundation / opensource-wg

GSF Open Source WG
Other
43 stars 8 forks source link

[Action Item] Set up convention for Carbon Data Interchange #60

Closed Sealjay closed 1 year ago

Sealjay commented 2 years ago

Discussed in https://github.com/Green-Software-Foundation/opensource-wg/discussions/58

Originally posted by **seanmcilroy29** November 3, 2022 Submitted by Chris Lloyd-Jones I've been chatting with people at Avanade, and we've noticed there are a lot of solutions tracking, producing and consuming carbon data right now, including: **Tools that track carbon data** - Cloud Carbon Footprint - Microsoft Sustainability Manager - SAP Carbon Footprint Analytics - Avanade's Isotope - https://azuremarketplace.microsoft.com/en-us/marketplace/apps/avanade-5299580.amp_isotope_access?tab=overview **Tools that produce carbon data** - Carbon Aware SDK - Metrikus - https://www.metrikus.io/ - CAST-IT - https://www.castsoftware.com/green-it - Carbon CI Pipeline **Tools that consume carbon data** Cloverly https://www.cloverly.com/ I'm noticing a common problem: - Tools don't measure discrete units of carbon in the same way, for example accounting for avoided carbon, or offset carbon - Tools don't use the same measurement standards, for either co2eq, or the units of measurement - It's difficult to link data from one system with another, without some kind of interchange or common format **Suggestion** Is there scope for a Carbon Data Interchange project within the Standard or Open Source Working group at GSF? I propose the project would: - Create a common data interchange format for sharing data about carbon between systems, ideally built upon an existing markup language like JSON-LD or YAML, so that a schema can be created This would provide a format that tools and organizations can use to share carbon data, in a standardized way, to avoid re-inventing the wheel in exports and imports. If interested, I'm happy to include folks from Avanade that have an interest in supporting this type of project, and I'm sure many of your organisations have the same. **Distro** I've included Open Source WG & Standards WG chairs, and folks who I think might be interested, based on the projects they work on, but please feel free to share more wid
dtoakley-tw commented 1 year ago

Chris update: was discussed at Standards WG, and aligned that it should just be a Convention under the OS WG for now rather than a Standard. There are numerous of initiatives outside the GSF that are attempted to do similar things. Need to determine the project chairs, who will create a PR FAQ.

seanmcilroy29 commented 1 year ago

Tools that track carbon data

Cloud Carbon Footprint
Microsoft Sustainability Manager
SAP Carbon Footprint Analytics
Avanade's Isotope - https://azuremarketplace.microsoft.com/en-us/marketplace/apps/avanade-5299580.amp_isotope_access?tab=overview

Tools that produce carbon data

Carbon Aware SDK
Metrikus - https://www.metrikus.io/
CAST-IT - https://www.castsoftware.com/green-it
Carbon CI Pipeline

Tools that consume carbon data

Cloverly https://www.cloverly.com/
Sealjay commented 1 year ago

@seanmcilroy29 - PRF that @KnowledgeRatio will complete

dtoakley-tw commented 1 year ago

@Sealjay @KnowledgeRatio -- we're going to wait until the next OS WG meeting for updates on this one. Looking forward to hearing more from you both!

KnowledgeRatio commented 1 year ago

@Sealjay @dtoakley-tw - Apologies, not been able to progress this as I had expected to. I will be redrafting the PRF shared previously and uploading over the next coming days and will share with this group once completed.

My update is that directionally, having reviewed what is available on the Open Group's efforts that are already further along here, it may be worthwhile looking to make a decision to adopt this framework. Currently, I'm still awaiting some further documentation to confirm before bringing options back to this WG.

Sealjay commented 1 year ago

@KnowledgeRatio - another one to review in scope of this project: https://www.lfenergy.org/projects/carbon-data-specification-cds/

KnowledgeRatio commented 1 year ago

PRF includes at the bottom a series of 'buckets' for requirements. The buckets are an epic level attempt at looking at what would be required from a CDIF, with some of those epics being meatier than others.

There is a need for support from the group (and beyond) on two key areas:

  1. To elaborate on these and build out more functional level requirements
  2. Support with outreach on engagement with existing frameworks and to understand how we may either adopt or fork from these depending upon requirements

Subject to the PRF being satisfactory, I feel it makes sense to start a project repo for CDIF.

Sealjay commented 1 year ago

PRF includes at the bottom a series of 'buckets' for requirements. The buckets are an epic level attempt at looking at what would be required from a CDIF, with some of those epics being meatier than others.

There is a need for support from the group (and beyond) on two key areas:

1. To elaborate on these and build out more functional level requirements

2. Support with outreach on engagement with existing frameworks and  to understand how we may either adopt or fork from these depending upon requirements

Subject to the PRF being satisfactory, I feel it makes sense to start a project repo for CDIF.

Great stuff @KnowledgeRatio! Subject to no objections on the call, I'm going to suggest we ask for the repo to be created on the WG call today @seanmcilroy29 @dtoakley-tw @dtoakley - we've had a lot of interest in this project, so I think it will be good to start so we have a place for people to collaborate from.

seanmcilroy29 commented 1 year ago

@KnowledgeRatio - Repo has been set up for you to start the gap analysis

dtoakley-tw commented 1 year ago

@Sealjay -- there is a proposal in the Standards WG for a real-time carbon data project, which would basically be the same as this. So this project or that could be the one to go forward -- either could work. Chris will share Josh's proposal with that project for context sharing as well.