search

tapis-project / tapis-systems

BSD 3-Clause "New" or "Revised" License
0 stars 1 forks source link

Systems: SGCI Resource Specification - Support API in Tapis V3 #3

Open scblack321 opened 3 years ago

scblack321 commented 3 years ago
scblack321 commented 3 years ago

The SGCI Resource Specification effort (aka Tech Summit) is creating a reference database (via github) and reference API implementation to be used for sharing HPC and Cloud resources. The goal is for Tapis V3 to support the reference API allowing for a Tapis site to pull in resource definitions, store them locally and make them available to site users. Except from 4/24/20 e-mail written by Joe S:

Gateways and frameworks can and should utilize a local, database-backed catalog of the resources that provides an API for searching for and reading the descriptions. That system should periodically sync/receive updates from github for changes. We will provide a reference implementation of this API system, and the major frameworks (Airavata, HubZero and Tapis) will commit to hosting said API system and incorporating it into their services.

Suresh and Dimuthu made some serious progress on the github catalog and reference implementation of the API, and they gave a walkthrough and demo of initial versions of each:
[1] https://github.com/SGCI/computational-resource-catalog
[2] https://github.com/SGCI/computational-resource-reference-implimentation

An instance of the reference API is deployed here, ready to be tried out:
https://resources.sgci.scigap.org

and there is some very nice documentation, including an overall workflow diagram here:
https://docs.google.com/document/d/1gr5dl-5qqlsajKYeUupc5seeDWAE2BaRGMmaJoKUaPY/edit

Big thanks to Suresh and Dimuthu for all of the above!

Our discussion also included the following points and action items:

1. The group thought it would be best to prioritize creating designs for how the resource API would be incorporated into the existing frameworks: Airavata, HubZero and Tapis. We expect the exercise of working out the designs to help improve and finalize the resource spec itself. Steve and Joe will work on Tapis and think about HPC resources, Suresh and Dimuthu will work on Airavata and think about HPC and cloud resource, Daniel will work on HubZero.
scblack321 commented 3 years ago

Add Tapis v3 Systems endpoints to create and update system definitions based on an SGCI Resource with the latest information from the SGCI Resource catalog.