MillionConcepts / pdr

[P]lanetary [D]ata [R]eader - A single function to read all Planetary Data System (PDS) data into Python
Other
62 stars 7 forks source link

revisit type checking in PDS3 ASCII tables/arrays #73

Open m-stclair opened 2 months ago

m-stclair commented 2 months ago

It might be time to revisit adding some kind of type checks for ASCII tables/arrays. Not all ASCII products have type specifications in metadata, so we can't do checks for every product. ASCII field/element type specifications are also often inconsistent, and we'd rather not have to write special cases for every product type in which -- just for instance -- a supposed ASCII_INTEGER is actually a float, but the table loads as the providers probably actually intended.

However, it may be useful to add some kind of soft and/or fuzzy checks in cases when metadata does provide specifications.

Also see discussion in this issue.