Data text delimited well formed - Githubissues

NCEAS / metadig-checks

MetaDIG suites and checks for data and metadata improvement and guidance.

Apache License 2.0

8 stars 9 forks source link

Data text delimited well formed #447

Open jeanetteclark opened 7 months ago

jeanetteclark commented 7 months ago

Status : ✍️ Drafted

Description

Check that a text delimited data file is well formed

Priority

Data Quality: Required

Issues

So far this isn't a great check since there are lots of ways to get a data frame read in, but not in the intention of the original data submitter. For example, you could potentially read in all of the columns into a single column and get a data frame and pass the check

Procedure

extract the fieldDelimiter and numHeaderLines for the data file
pass that into read.table along with the file path
if the result of read.table is a data frame the check is considered to have passed