New Task: For raw ATN trajectory data sets, finalize and implement automated NCEI data archive pathway

MathewBiddle commented 2 months ago

Who is requesting this?

@ioos/marine-life, and the ATN community

What is being requested?

final agreement of nc metadata attributes with NCEI
create metadata and format file template for NCEI review
- https://github.com/ioos/marine_life_data_network/issues/16
test load template to NCEI ftp site/ WAF
begin operationally submitting non-embargoed deployments to NCEI
create automated service within ATN DAC Reg App for grouping deployments into synthetic 'projects' and connecting metadata returned from NCEI for access by PIs
Ensure archived data, dataset citations and DOIs are integrated into ATN DAC portal catalog
Update documentation at https://ioos.github.io/ioos-atn-data/atn-sat-telem-specification-v1-0.html to reflect current netCDF implementation.
Document issues and proposals for future versions at https://github.com/ioos/ioos-atn-data/issues

What is the requested deadline and why?

No response

What is the current status quo (i.e., what happens if this does not get done)?

ATN tajectory data are not archived at NCEI and PARR requirements are not met.

What indicates this is done (i.e., how do we know this is complete)?

[ ] NCEI automatically pulls data from ATN on identified frequency
[ ] IOOS publishes a news story about it.
[ ] Add “gold standard” example files to https://github.com/ioos/erddap-gold-standard/tree/main/datasets and make them accessible via https://standards.sensors.ioos.us/erddap/index.html

Provide a description or any other important information.

xref:

MathewBiddle commented 2 months ago

What does "and archive administrative tools" mean in the title?

MathewBiddle commented 1 month ago

@iamchrisser @mmckinzie where are we with this automation? Are the file structures settled?

I'd like to release v1.0 of the template, update the website, and stick a fork in the automation task so we can move to mobilizing these data to obis and move on to the profile stream.

MathewBiddle commented 1 month ago

Getting close. Have a manual process built for now but working on automating. Ran into some issues with seaname mappings.

ioos / marine_life_data_network