Open seanmcilroy29 opened 3 weeks ago
Attended! 🌳
Attended
attended
Attended
Attended
Attended
MoM Sean opens the meeting at 1600 (BST)
Chris emphasized the significance of carbon efficiency in large language models. Asim recommended establishing processes for consensus-building in larger organizations. Asim also proposed a path to ISO adoption from a regulatory perspective as Northstar's objective and provided evidence of consensus through feedback.
Chris discussed open-source initiatives for industry transformation, the SCER specification for efficient routing in the industry, and a 4-step process for software cost categorization and benchmarking. Additionally, Gadhu discussed changes in categorizing language models based on size and application type.
Asim suggests categorization and benchmarking for large Lego models, with Chris providing examples. Chris outlines a 4-step process for standardizing national models, including measurement methods and workload (uses current kilowatt hours). Chris suggests aligning token disclosure with SCI to facilitate adoption and streamline work (10 years' worth of work).
Chris discussed challenges in comparing LLMs' performance scores, Hugging Face's role in hosting and benchmarking language models, and challenges in categorizing software due to its diverse range of functions.
Asim and Navveen discussed the challenges of categorizing and comparing AI models. Navveen proposed extending SCI specifications to accommodate LLMs and scenario ratings. They also talked about potential extensions to the SCI standard for AI and cloud computing. Thomas questions the spec's implementation and the providers' responsibility to provide information. Chris discussed collaboration with Hogging Face to improve LLM testing reproducibility.
Asim stresses the importance of managing intellectual property (IP) and royalties properly in collaborations. Asim believes that providing evidence is crucial for proving Social and Environmental Impact (SCI) scores. He suggests that linking manifest files to scores can create strong support among different measurement tools. Asim thinks it is important to have a common evidence file format for the impact framework, and believes that the focus should be on developing tools for the impact framework.
Members discuss developing a global label for software projects to provide transparency on carbon footprint. Asim suggests open-source LLM models for labelling and verifying emissions reductions. The group discussed updates to the SCI methodology and potential regulatory issues.
Action Items
2024.06.06 Agenda/Minutes
Time 1600 (GMT) - See the time in your timezone
Antitrust Policy
Joint Development Foundation meetings may involve participation by industry competitors, and the Joint Development Foundation intends to conduct all of its activities in accordance with applicable antitrust and competition laws. It is, therefore, extremely important that attendees adhere to meeting agendas and be aware of and not participate in any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws.
If you have questions about these matters, please contact your company counsel or counsel to the Joint Development Foundation, DLA Piper.
Recordings
WG agreed to record all Meetings. This meeting recording will be available until the next scheduled meeting.
Roll Call
Please add 'Attended' to this issue during the meeting to denote attendance.
Any untracked attendees will be added by the GSF team below:
Agenda
New Member Introduction
Project Deep Dive review
Techstrong TV Sustainability Interview with Bonnie Schneider - Sean
GreenAI - Discussion Continued - Henry / Thomas
Project Review updates
Articles
For Review
Note: WG use case template submission - After submitting this issue, your use case will be submitted to the WG Agenda for discussion. Article submission—Once you submit this issue, it will be assigned to the GSF Editor for review.
Future meeting Agenda submissions
Next Meeting
Adjourn
[x] Motion to adjourn
Standing Agenda / Future Agenda submissions