search

HEGSRR / HEGSRR-Template

Template documents and packages for study pre-registration, reproductions, and replications
https://hegsrr.github.io/HEGSRR-Manual
BSD 3-Clause "New" or "Revised" License
13 stars 5 forks source link

2 considerations: metadata standards and ROI/AOI data #4

Closed josephholler closed 1 year ago

josephholler commented 3 years ago

two thoughts:

1) perhaps we should be adopting some generally accepted standards for spatial metadata, e.g. from OGC or the national infrastructure

2) I'd be ideal to have a GEOJSON file of the area of interest / ROI / study extent, because this can be automatically rendered on leaflet map while viewing the repository on GitHub

josephholler commented 3 years ago

most promising resource: web-based metadata editor, including geospatial: https://www.mdeditor.org/ (but still in development, and doesn't have a straightforward way to document attributes)

most useful federal page so far: https://www.usgs.gov/products/data-and-tools/data-management/metadata-creation also, https://www.fgdc.gov/metadata

R package geometa https://cran.r-project.org/web/packages/geometa/index.html R raster metadata function https://www.rdocumentation.org/packages/raster/versions/3.4-10/topics/metadata Python geospatial metadata package: https://pypi.org/project/pygeometa/

GeoNetwork https://geonetwork-opensource.org/ is an OSGeo project to create a metadata catalog & search platform with rich metadata editing capabilities. pycsw https://pycsw.org/ is a python tool for importing metadata XML files and providing them in a searchable interface compliant with the OGC standards for metadata catalogue services. It seems like OGC has not defined their own metadata standard, and instead implement ISO or FGDC standards. Since FGDC is now encouraging use of the ISO standard... our only sensible option is to use ISO. Here's a resource on ISO from the FGDC: https://www.fgdc.gov/metadata/iso-standards and here's the ISO catalog: https://www.iso.org/committee/54904/x/catalogue/ (for purchase)

catMDEdit is a desktop metadata editor https://sourceforge.net/projects/catmdedit/ but looks like it runs as a Java application.

arrg: aren't there any good tools for doing this LOCALLY? GeoCat https://www.geocat.net/ is another meant to create a geospatial catalogue service, and has geocatbridge (QGIS plugin)

XML Notepad may be helpful: https://microsoft.github.io/XmlNotepad/

QGIS Plugin: ISOGeo: https://help.isogeo.com/qgis/en/ (mostly French -- and nevermind, it's also a company creating a plugin to connect to web services https://www.isogeo.com/page/In-english-please )

Metatools existed for QGIS versions < 3.0 https://github.com/nextgis/metatools

josephholler commented 3 years ago

generally, research repositories are expected to implement the Dublin Core standards: https://dublincore.org/

josephholler commented 3 years ago

the Data Documentation Initiative is often used for social science survey data: https://ddialliance.org/resources/tools https://ddialliance.org/

josephholler commented 3 years ago

Research Data Alliance https://rd-alliance.org/ created the Metadata Directory http://rd-alliance.github.io/metadata-directory/

josephholler commented 3 years ago

Here is a workspace metadata crawler for geospatial data! https://github.com/talend-spatial/workspace-metadata-crawler

josephholler commented 3 years ago

The Australian government has a downloadable tool and a bunch of training information: https://www.anzlic.gov.au/resourcesarchived-foundation-spatial-data-framework/metadata

josephholler commented 3 years ago

North American (USA / Canada) profile of geospatial metadata based on ISO 19115 https://www.fgdc.gov/standards/projects/incits-l1-standards-projects/NAP-Metadata

josephholler commented 3 years ago

The GeoNetwork documentation for describing information is helpful! https://geonetwork-opensource.org/manuals/3.10.x/en/user-guide/describing-information/index.html

josephholler commented 3 years ago

ok, moving along.
FGDC standards for geospatial data: https://www.fgdc.gov/metadata/csdgm-standard The USGS Fort Collins group made a cross platform open source version of their metadata wizard for FGDC content standard for digital geospatial metadata (CSDGM): https://github.com/usgs/fort-pymdwizard
This is actually a pretty nice stand-alone program for both Windows and MacOS for generating FGDC metadata in XML format. It also contains a preview where it generates HTML of the metadata. It's only for FGDC-STD-001-1998 or the biological/taxonomic extension. It DOES read data files and automatically populate both spatial data and attribute data!

josephholler commented 3 years ago

Daniel Nust and the o2r project are developing a metadata component for the executable research compendium, o2r-meta: https://github.com/o2r-project/o2r-meta
It's designed to semi-automate metadata extraction from contents of the compendai! It appears to implement a limited o2r metadata schema at present (not full ISO or FDGC)

josephholler commented 1 year ago

Summarized these challenges in a conference paper: https://isprs-archives.copernicus.org/articles/XLVIII-4-W1-2022/201/2022/

There's no immediate solution for our compendium without building new software.