search

open-gamma-ray-astro / gamma-astro-data-formats

Data formats for gamma-ray astronomy
https://gamma-astro-data-formats.readthedocs.io
Creative Commons Attribution 4.0 International
29 stars 27 forks source link

File Formats #161

Open maxnoe opened 4 years ago

maxnoe commented 4 years ago

Triggered by a discussion in the CTA IRF group about what this standard says about file formats, we need to clean up some inconsistencies.

E.g. the about section claims:

All of the data formats described here at the moment can be, and in practice mostly are, stored in FITS. Some experimentation with HDF5 and ECSV is ongoing. The data format specifications don’t explicity mention the serialisation format, but rather the key name and data type for each metadata or data field.

But the EVENTS documentation clearly states:

The EVENTS extension is a binary FITS table that contains an event list.

I guess we want to be open about this. It might be difficult to remain file format agnostic in the definitions while still being normative enough for a specific file format.

So maybe we should mark sections specific to certain file formats clearly as such, right now mostly for FITS specific things, but maybe nicely extendable to e.g. HDF5.

jknodlseder commented 4 years ago

CTA is committed to FITS for the data that will be shipped to the User.

Le 20 mai 2020 à 21:13, Maximilian Nöthe notifications@github.com a écrit :

Triggered by a discussion in the CTA IRF group about what this standard says about file formats, we need to clean up some inconsistencies.

E.g. the about section claims:

All of the data formats described here at the moment can be, and in practice mostly are, stored in FITS. Some experimentation with HDF5 and ECSV is ongoing. The data format specifications don’t explicity mention the serialisation format, but rather the key name and data type for each metadata or data field.

But the EVENTS documentation clearly states:

The EVENTS extension is a binary FITS table that contains an event list.

I guess we want to be open about this. It might be difficult to remain file format agnostic in the definitions while still being normative enough for a specific file format.

So maybe we should mark sections specific to certain file formats clearly as such, right now mostly for FITS specific things, but maybe nicely extendable to e.g. HDF5.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/open-gamma-ray-astro/gamma-astro-data-formats/issues/161, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAW2QV6JWEYFG2QO4TARL6TRSQTULANCNFSM4NGHQVQQ.

maxnoe commented 4 years ago

I know. But how should this affect the question?

Are you proposing to remove the comments about file format agnosticism and fully commit to being a FITS based standard?