ess-dive-community / essdive-file-level-metadata

READY TO USE. Reporting format for File Level Metadata uploaded to the ESS-DIVE repository
https://ess-dive.gitbook.io/file-level-metadata-reporting-format/
Creative Commons Attribution 4.0 International
2 stars 3 forks source link

Noting Header_Row Amount on FLMD File #28

Closed dylanporyan closed 1 month ago

dylanporyan commented 2 years ago

Submitter: Dylan O'Ryan

Question for @tvelliquette: It is unclear on how to note header_row amount within data files on the FLMD file. Based on the CSV reporting format reccomendation for units on data files, we have included a units row "immediately below the Column Name as a next row." While we (ESS-DIVE) were attempting to parse some data files using the CSV and FLMD reporting format, I was unable to find guidance on noting header_row amounts on both FLMD and CSV reporting formats.

Should users of the CSV and FLMD reporting formats add an additional column to the FLMD file to note the header_row amount in a data file? Or is there an alternative suggestion for noting header_row amounts?

tvelliquette commented 2 years ago

@dylanporyan I am not sure I understand the question. What is meant by "header_row amounts"?

dylanporyan commented 2 years ago

Hi @tvelliquette, for header_row amount -- we are meaning the number of rows before the start of the data. For example,

This particular data file has 2 header_rows (column_header row and unit row).

Screen Shot 2022-09-13 at 8 55 29 AM

Whereas, this particular data file has 5 header_rows (using the Hydrological Monitoring RF and has the header_row number as a field).

Screen Shot 2022-09-13 at 8 54 44 AM

Please let me know if this makes sense or if I can clarify further.

tvelliquette commented 2 years ago

@dylanporyan That makes sense. This version 1.0 of the FLMD reporting format is a streamlined version of the initial drafts. Header information was part of the CSV Reporting Format very early on. The decision was made to start small but to continue to refine and potentially expand the reporting format in newer versions. There are quite a few issues/discussions that might provide a reason for at least a minor update.

dylanporyan commented 1 month ago

Version 1.1.0 (v1.1.0) has been released and merged within the main branch. This subsequent version has added the "header_rows" as a column header within the FLMD file, as requested. Done.