NeurodataWithoutBorders / nwb-schema

Data format specification schema for the NWB neurophysiology data format
http://nwb-schema.readthedocs.io
Other
53 stars 16 forks source link

add Measurement neurodata_type #208

Open bendichter opened 6 years ago

bendichter commented 6 years ago

There is currently no schema-wide standard for associating measured data with the measurement unit. I like the method used in TimeSeries.data, which uses unit (as in measurement unit, e.g. 'meters') conversion and resolution. This seems like the minimum structure needed to be both flexible and specific. On the other hand there are parts of the schema where measurement units are not treated with so much care, and several places where units are indicated as part of the doc string of the attribute, which is inflexible, not machine-readable, and inconsistent with the convention used in TimeSeries.data. I would like to see the standard used in TimeSeries.data used as a standard across the schema, including data elements that are not collected across time. The advantage of this is it will give us an NWB-wide standard for indicating measurements that can be used in other places (e.g. wavelength parameters in ophys) and in extensions.

Specifically, I propose the addition of a new Measurement dataset neurodata_type with attributes unit, conversion and resolution and dtype: numeric (depends on https://github.com/NeurodataWithoutBorders/pynwb/issues/594). For the units field, it would be ideal if we could enforce standards for accepted unit strings. @nicain pointed me to the unidata units database, which seems like a good standard. We could check and make sure the units are an accepted term or abbreviation so that they are machine readable.

It would be ideal if this was used in place of TimeSeries.data. This would not necessarily change the user interface for TimeSeries, but would break reading of all TimeSeries objects written before the change! Since we are now past the deadline for schema-breaking changes, I'll propose a compromise: add Measurement now, and incorporate it fully into the schema for the 3.0 release.

rly commented 4 years ago

This should extend VectorData.