NIH AIM:3 YR:2 TASK:1 | 2.3.1 | Support biomedical workflows

[mreekie]

Discussion with Mahmood.

• Implementation will not be a challenge.
• When computational workflow was done, we added a new metadata block.
• The metadata terms need to be reviewed.
• In upload page, not every field for code-meta is exposed.
• In a meeting with Phillip, Oliver, Ana, Julian - finalize the metadata terms.
• Ensure that what is included is correct and theen this can be merged.

Predecessor: 1.3.2 | 3 | Research and discovery phase for biomedical workflows support | 5

Part of this sequence of deliverables: 1.3.1 | 3 | Support software metadata | 5 1.3.2 | 3 | Research and discovery phase for biomedical workflows support | 5 2.3.1 | 3 | Support biomedical workflows | 5 2.3.2 | 3 | Research and discovery phase for containers and research objects support | 5 3.3.1 | 3 | Support containers and research objects  | 10 4.3.1 | 3 | Apply container, RO, workflows support to a few NIH-funded projects | 10

┆Issue is synchronized with this Smartsheet row by Unito

[mreekie]

This issue represents a deliverable funded by the NIH This deliverable supports the NIH Initiative to Improve Access to NIH-funded Data

Aim 3: Support standards for sharing code, workflows, and containers

The Harvard Dataverse currently supports depositing any type of file, including code/software and documentation files that accompany data, or files within a research replication package. In this project, we plan to facilitate researchers’ efforts to share and publish their entire workflows or containers that describe the main transformations and analysis of the data, following the FAIR (Findable, Accessible, Interoperable, and Reusable) principles. As a result, the research findings will be portable and reproducible (ideally) with a single command. Though the services will be available to any researcher, special attention will be given to the NIH-funded work. The Dataverse project has already undertaken the development of Codemeta metadata (based on the standard schema.org) within the software. The project will assess the use of Codemeta for research software code and incorporate RO-Crate (for research objects metadata), which allows high flexibility in replication package content. Further, we will explore container metadata and the use of standardized container images for research. Containerization services, including software security scanning, exist for the Harvard Medical School (HMS) O2 high performance computing cluster, are in use by a number of laboratories, and are being developed by BioGrids, a HMS partner that specializes in creating replicable biomedical software packages and containers. As part of this project, we will explore the integration of these containerization services with the Harvard Dataverse repository to support sharing, discovery, and archival of replicable biomedical research.

1.3.1 | 3 | Support software metadata | 5 1.3.2 | 3 | Research and discovery phase for biomedical workflows support | 5 2.3.1 | 3 | Support biomedical workflows | 5 2.3.2 | 3 | Research and discovery phase for containers and research objects support | 5 3.3.1 | 3 | Support containers and research objects  | 10 4.3.1 | 3 | Apply container, RO, workflows support to a few NIH-funded projects | 10

[mreekie]

original comment

Next step here is to touch base with the person from the community who is working on this already (@pdurbin) mentioned the connection today.

That would be @carlsonp and @poikilotherm who met today and plan to meet again on Thursday.

[mreekie]

Monthly January;

(2.3.1) Initial meeting was held. Work will focus on a new metadata block was already added as part of (1.3.2). The next step is finalizing the metadata terms.

Febrary 2023 update

• (2.3.1) Initial meeting was held. Work will focus on a new metadata block which was added as part of (1.3.2). The next step is finalizing the metadata terms. This activity will continue in year 2 as planned.
• (2.3.2) We recently implemented an intermediate solution that provides the ability to run data analysis in an external container using Binder. Few minor fixing done during this month.

[mreekie]

March Update:

(2.3.1) We were able to get a small head start on 2.3.1 (3%) in year 1. Initial meeting was held. Work will focus on a new metadata block which was added as part of (1.3.2). The next step is finalizing the metadata terms. This activity will continue in year 2 as planned.

[cmbz]

2024/01/03: Closing, work will be tracked here: https://github.com/IQSS/dataverse-pm/issues/149 and here: https://github.com/IQSS/dataverse-pm/issues/146