fathomnet / community-feedback

1 stars 0 forks source link

Assemble the archive package (the fathomnet database backup) with the required metadata for NOAA. #168

Open hohonuuli opened 2 weeks ago

hohonuuli commented 2 weeks ago

Metadata for database package

FathomNet data package description:

title of the data package that will be archived at NCEI

Title: FathomNet: An open-source image database for training, testing, and validating machine learning algorithms to help us understand our ocean and its inhabitants.

Description: The ocean is experiencing unprecedented rapid change, and visually monitoring marine biota at the spatiotemporal scales needed for responsible stewardship is a formidable task. Recent advances in machine learning enables fast, sophisticated analysis of visual data, but have had limited success in the ocean due to lack of data standardization, insufficient formatting, and demand for large, labeled datasets. To address this need, FathomNet provides an open-source image database that standardizes and aggregates expertly curated labeled data that can be used to train, test, and validate state-of-the-art artificial intelligence algorithms. FathomNet has been seeded with existing iconic and non-iconic imagery of marine animals, equipment, debris, and other concepts, and allows for future contributions from distributed data sources.

author and institution list for the data package that will be archive at NCEI

@hohonuuli will be generating this from the FathomNet API

a preview graphic (image) that you would like to represent the package for use on the NCEI website

FathomNet_Squid_KLance_2020

hohonuuli commented 2 weeks ago

I'm looking into tools to dump out the SQL Server database data as SQL. Microsoft supplies sqlcmd which might do the trick.

hohonuuli commented 2 weeks ago

sqlcmd doesn't seem to do the trick. I threw together a proof of concept here