search

Green-Software-Foundation / real-time-cloud

Other
49 stars 1 forks source link

2024.10.08 #66

Open seanmcilroy29 opened 2 days ago

seanmcilroy29 commented 2 days ago

2024.10.08 Agenda/Minutes

Time 0800 (PT) / 1600 (BST) - See the time in your timezone

If you have questions about these matters, please contact your company counsel or counsel to the Joint Development Foundation, DLA Piper.

Recordings

WG agreed to record all Meetings. This meeting recording will be available until the next scheduled meeting.

Roll Call

Please add 'Attended' to this issue during the meeting to denote attendance.

Any untracked attendees will be added by the GSF team below:

PR approval

Impact Framework

Next Steps

Ref Material

AOB

seanmcilroy29 commented 2 days ago

Minutes

Meeting Summary Notes

The team discussed integrating metadata into the Impact Engine framework using a generic CSV lookup plugin. They addressed the need to move the CSV file from dev to main for a stable URL and to ensure users build on top of the canonical data. They reviewed the process of mapping cloud provider and region data from CSV files, including handling timestamps and gaps in data. The conversation also covered the challenges of obtaining comprehensive data from cloud providers like Google and Microsoft and the potential for policy recommendations to standardize data disclosure. The team plans to update the data with best guesses and monitor upcoming EU regulations.

MoM

Impact Engine Framework Discussion Joseph explains that the new model uses generic plugins, specifically a generic CSV lookup plugin, which requires no adapters and can pull data from a GitHub repository URL. Adrian raises concerns about existing data overlapping with the new data and how to ensure people use the canonical data. Joseph clarifies that the old CSV file has been moved to a "if data" repository and can be deleted, with the new plugin agnostic to the target data.

Data Integration and Pipeline Updates Adrian suggests moving the URL from dev to main for stability and updating example pipelines to use the new data. Joseph offers to share a pipeline walkthrough from the docs website, which can be copied or used as a starting point. The discussion includes mapping cloud provider and region data from the CSV file, with Adrian noting the need to map timestamps to years. Joseph mentions using regex plugins to extract specific data from the CSV file and demonstrates the process in VS Code.

Testing and Verification of Data Joseph demonstrates the plugin's functionality using the new URL. The team verifies the data mapping and identifies gaps in the 2023 data, discussing potential solutions for filling these gaps. Adrian suggests labelling best guesses for missing data and creating a separate file for these estimates. The conversation shifts to the importance of making the data valuable for users and the challenges of obtaining complete and up-to-date data from cloud providers.

Cloud Provider Data and Policy Recommendations The team discusses the challenges of obtaining data from cloud providers like Google and Microsoft, with Adrian noting the inconsistency in data publication. Pindy raises the issue of colocation providers and the potential to obtain data from other sources to fill gaps. Adrian suggests creating a policy recommendation for cloud providers to ensure consistent and comprehensive data disclosure. The team considers the potential impact of the EU's upcoming data disclosure requirements and the need for cloud providers to align their data practices.

Next Steps and Action Items Adrian emphasizes the importance of institutionalizing data publication processes within cloud providers to ensure long-term consistency. The team discusses the need for regular updates and communication with cloud providers to address gaps or issues. Adrian suggests building a copy of the data with best guesses for missing information to make it more useful for the Impact Engine framework.

Action Items