search

iodepo / odis-arch

Development of the Ocean Data and Information System (ODIS) architecture
https://book.odis.org/
29 stars 17 forks source link

connect Helio-KNOW graph as ODIS node #397

Open jmckenna opened 7 months ago

jmckenna commented 7 months ago

Possible next steps:

cc @rmcgranaghan

rmcgranaghan commented 6 months ago

Hi @jmckenna thanks for creating this

I'm now preparing for a working meeting with you. What would be excellent to have ready prior to our discussion?

jmckenna commented 6 months ago

hi @rmcgranaghan, related to the first step above of "draft a JSON-LD template together", maybe have a sample "dataset" or other type, that we can draft a template together for. The different types of templates are listed here, for example, inside the "dataset/graphs" folder there, there is a datasetTemplate.json that we could possibly adapt together for one of your datasets.

jmckenna commented 6 months ago

@rmcgranaghan in other words, the goal will be to adapt metadata for one of your datasets, into that template.

jmckenna commented 6 months ago

@rmcgranaghan then the goal will be to validate your metadata template, through the schema.org validator. We can explain all this during that tech meeting.

rmcgranaghan commented 6 months ago

Thanks for this outstanding guidance @jmckenna

tagging my colleague @lechatpito who will be collaborating with me on this. We will review this thread and schedule a technical meeting with you

rmcgranaghan commented 5 months ago

@jmckenna

Two quick thoughts and then I think we will be ready for a technical meeting:

  1. We have this for general Helio data https://hpde.io/ - does that meet the requirements you are hoping for?
  2. I'm working on something similar, but specifically to be used for Heliophysics phenomena (the holy grail for science researchers to be able to search and discover by).
rmcgranaghan commented 4 months ago

@jmckenna please excuse the ping, but a friendly check-in on the comment above to find out if that is something with which we could move forward? Additionally, @lechatpito is now more familiar with the ODIS architecture and we might be in a good place to hold the first technical discussion

lechatpito commented 4 months ago

@rmcgranaghan is there a Helio-KNOW dataset you have in mind that has Ocean related data? eg effect of the sun on ocean tides... Once we have identified that dataset I can start working on the JSON-LD template.

rmcgranaghan commented 4 months ago

@lechatpito good question - we are interested in exploring this architecture to create more of a Heliophysics data exchange rather than directly tie it to the ocean system right now. That being said, there are clear interconnections, which are spelled out in places like the Environment Ontology (ENVO) https://www.ebi.ac.uk/ols4/ontologies/envo and SWEET (sweetontology.net/)

rmcgranaghan commented 2 months ago

@jmckenna friendly reminder about this open issue - would you like to schedule a technical working session?

jmckenna commented 2 months ago

@rmcgranaghan sincere apologies for the quietness on our side, will send you an email about the next technical working session, to keep the momentum going :)

jmckenna commented 2 months ago

@lechatpito @rmcgranaghan I was using this entry to check for JSON-LD embedded on the page, here are some comments (to re-start the discussion), I have also pasted the raw JSON-LD below, for others like @pbuttigieg to give you more feedback):

{
        "@context": "https://schema.org/",
        "@type" :"Dataset",
        "name": "Australian Space Weather Services, SWS, Culgoora Solar Observatory Solar Image",

        "dateModified": "2022-02-24",
                "identifier": "spase://ASWS/DisplayData/Solar_Image/Clg_Solar_Image",
                "creditText": "We are thankful to the Culgoora Solar Observatory of Space Weather Network, Bureau of Meteorology of Australia for the observations of Culgoora Solar Image data.",
        "description": "Australia has made major contributions to research in solar physics for several decades. Solar images are a major kind of records of solar activities. The SWS has monitored and archived solar activity images from Culgoora and Learmonth for more than two decades. They include H-Alpha (2003-2014) and White Light (2004-2013) images from Culgoora, and H-Alpha (2004-2009), GONG H-Alpha (since 2013), GONG White Light (since 2010), and GONG Magnetogram (since 2010) images from Learmonth. A new set of three telescopes, which are on a single mount, has installed at Culgoora. Culgoora solar image data are available since 2003-02-01.",
        "abstract": "Australia has made major contributions to research in solar physics for several decades. Solar images are a major kind of records of solar activities. The SWS has monitored and archived solar activity images from Culgoora and Learmonth for more than two decades. They include H-Alpha (2003-2014) and White Light (2004-2013) images from Culgoora, and H-Alpha (2004-2009), GONG H-Alpha (since 2013), GONG White Light (since 2010), and GONG Magnetogram (since 2010) images from Learmonth. A new set of three telescopes, which are on a single mount, has installed at Culgoora. Culgoora solar image data are available since 2003-02-01.",
        "temporalCoverage": "2003-01-02T05:00:00Z/...",
                 "genre": "Spectrum",
        "keywords": [  "Solar Image", "H-Alpha Image", "White Light Image" ],
        "license": "https://cdla.io/permissive-1-0/",
                "audience":{
                  "@type": "Audience",
                  "audienceType": ["Space Physicist", "Space Community", "Data Scientists", "Machine Learning Users"]
                }
}
pbuttigieg commented 2 months ago

Thanks @jmckenna

in addition:

lechatpito commented 1 month ago

Thank you both for your suggestions, here is an updated version of the example:

{
        "@context": "https://schema.org/",
        "@id": "https://hpde.io/ASWS/DisplayData/Solar_Image/Clg_Solar_Image", 
        "@type" :"Dataset",
        "name": "Australian Space Weather Services, SWS, Culgoora Solar Observatory Solar Image",
        "url": "https://hpde.io/ASWS/DisplayData/Solar_Image/Clg_Solar_Image.html",
        "publisher": {
            "@type": "Person",
            "identifier": "spase://ASWS/Person/Kehe.Wang",
            "url": "http://hpde.io/ASWS/Person/Kehe.Wang"
        }
        "sdDatePublished": "2022-02-24",
        "sdPublisher": {
             "@type": "Organization",
             "name": "hdpe.io"
        }
        "includedInDataCatalog": {
            "@type": "DataCatalog",
            "name": "HPDE.io / SPASE"
        }
        "identifier": "spase://ASWS/DisplayData/Solar_Image/Clg_Solar_Image",
        "creditText": "We are thankful to the Culgoora Solar Observatory of Space Weather Network, Bureau of Meteorology of Australia for the observations of Culgoora Solar Image data.",
        "description": "Australia has made major contributions to research in solar physics for several decades. Solar images are a major kind of records of solar activities. The SWS has monitored and archived solar activity images from Culgoora and Learmonth for more than two decades. They include H-Alpha (2003-2014) and White Light (2004-2013) images from Culgoora, and H-Alpha (2004-2009), GONG H-Alpha (since 2013), GONG White Light (since 2010), and GONG Magnetogram (since 2010) images from Learmonth. A new set of three telescopes, which are on a single mount, has installed at Culgoora. Culgoora solar image data are available since 2003-02-01.",
        "abstract": "Australia has made major contributions to research in solar physics for several decades. Solar images are a major kind of records of solar activities. The SWS has monitored and archived solar activity images from Culgoora and Learmonth for more than two decades. They include H-Alpha (2003-2014) and White Light (2004-2013) images from Culgoora, and H-Alpha (2004-2009), GONG H-Alpha (since 2013), GONG White Light (since 2010), and GONG Magnetogram (since 2010) images from Learmonth. A new set of three telescopes, which are on a single mount, has installed at Culgoora. Culgoora solar image data are available since 2003-02-01.",
        "temporalCoverage": "2003-01-02T05:00:00Z/...",
        "variableMeasured": "Spectrum",
        "spatialCoverage": ["Sun", "Earth.Magnetosphere", "Heliosphere.Inner", "Heliosphere.Outer"],
        "keywords": [  "Solar Image", "H-Alpha Image", "White Light Image" ],
        "license": "https://cdla.io/permissive-1-0/",
                "audience":{
                  "@type": "Audience",
                  "audienceType": ["Space Physicist", "Space Community", "Data Scientists", "Machine Learning Users"]
                }
}
pbuttigieg commented 1 month ago

Some refinements (as rough notes during a meeting):

Main ideas:


{
      "@context": {
        "@vocab": "https://schema.org/"
         },
        "@id": "https://hpde.io/ASWS/DisplayData/Solar_Image/Clg_Solar_Image", 
        "@type" :"Dataset",
        "name": "Australian Space Weather Services, SWS, Culgoora Solar Observatory Solar Image",
        "url": "https://hpde.io/ASWS/DisplayData/Solar_Image/Clg_Solar_Image.html",
        "publisher": {
            "@type": "Person",
            "identifier": "spase://ASWS/Person/Kehe.Wang",
            "url": "http://hpde.io/ASWS/Person/Kehe.Wang"
        },
        "sdDatePublished": "2022-02-24",
        "sdPublisher": {
             "@type": "Organization",
             "name": "hdpe.io"
        },
        "distribution": {
            "@type": "DataDownload",
            "contentUrl": "http://urlToDirectDownloadOfThisDataset.org/",
            "encodingFormat": "text/csv"
        },
        "includedInDataCatalog": {
            "@type": "DataCatalog",
            "name": "HPDE.io / SPASE",
            "url": "..."
        },
        "identifier": "spase://ASWS/DisplayData/Solar_Image/Clg_Solar_Image",
        "creditText": "Wang, K. (2024) Australian Space Weather Services, SWS, Culgoora Solar Observatory Solar Image.",
        "description": "Australia has made major contributions to research in solar physics for several decades. Solar images are a major kind of records of solar activities. The SWS has monitored and archived solar activity images from Culgoora and Learmonth for more than two decades. They include H-Alpha (2003-2014) and White Light (2004-2013) images from Culgoora, and H-Alpha (2004-2009), GONG H-Alpha (since 2013), GONG White Light (since 2010), and GONG Magnetogram (since 2010) images from Learmonth. A new set of three telescopes, which are on a single mount, has installed at Culgoora. Culgoora solar image data are available since 2003-02-01.",
        "abstract": "Australia has made major contributions to research in solar physics for several decades. Solar images are a major kind of records of solar activities. The SWS has monitored and archived solar activity images from Culgoora and Learmonth for more than two decades. They include H-Alpha (2003-2014) and White Light (2004-2013) images from Culgoora, and H-Alpha (2004-2009), GONG H-Alpha (since 2013), GONG White Light (since 2010), and GONG Magnetogram (since 2010) images from Learmonth. A new set of three telescopes, which are on a single mount, has installed at Culgoora. Culgoora solar image data are available since 2003-02-01.",
        "temporalCoverage": "2003-01-02T05:00:00Z/...",
        "variableMeasured": "Spectrum",
        "spatialCoverage": [
            {
            "@type": "Place",
            "name": "Planetary Magnetosphere",
            "keywords":[
            { 
                "@type": "DefinedTerm",
                "url": "https://astrothesaurus.org/",
                "name": "Planetary magnetosphere",
                "inDefinedTermSet": "https://github.com/astrothesaurus/UAT/blob/master/UAT.json",
                "identifier": "http://astrothesaurus.org/uat/997",
                "termCode": "997",
                "description": "Planetary magnetosphere"
            }
            ]
            },
           {
            "@type": "Place",
            "name": "Sun"
           } 

            ],
        "keywords": [  "Solar Image", "H-Alpha Image", "White Light Image" ],
        "license": "https://cdla.io/permissive-1-0/",
                "audience":{
                  "@type": "Audience",
                  "audienceType": ["Space Physicist", "Space Community", "Data Scientists", "Machine Learning Users"]
                }
}
jmckenna commented 2 weeks ago

For the records: the ODISCat entry is https://catalogue.odis.org/view/3310

jmckenna commented 2 weeks ago

update: the ODIS Dashboard is showing no issues with the SPASE sitemap, finding 584 JSON-LD records. (those records are not yet harvested into the ODIS graph, which is why the other values are empty)

Screenshot 2024-09-13 at 2 44 54 PM

lechatpito commented 2 weeks ago

🎉

On Fri, Sep 13, 2024, 1:47 PM Jeff McKenna @.***> wrote:

update: the ODIS Dashboard http://dashboard.oceaninfohub.org/ is showing no issues with the SPASE sitemap, finding 584 JSON-LD records. (those records are not yet harvested into the ODIS graph, which is why the other values are empty)

Screenshot.2024-09-13.at.2.44.54.PM.png (view on web) https://github.com/user-attachments/assets/5a840fdd-870a-4986-8740-873d0c04c42d

— Reply to this email directly, view it on GitHub https://github.com/iodepo/odis-arch/issues/397#issuecomment-2349644199, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABMC7VY5VQDQSXYO3W7KOLZWMQJRAVCNFSM6AAAAABDACLD72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNBZGY2DIMJZHE . You are receiving this because you were mentioned.Message ID: @.***>