search

LSSTDESC / DC2-production

Configuration, production, validation specifications and tools for the DC2 Data Set.
BSD 3-Clause "New" or "Revised" License
11 stars 7 forks source link

Fix type of MJD in variability truth tables #425

Closed JoanneBogart closed 3 years ago

JoanneBogart commented 3 years ago

The sqlite versions of variability truth tables each contain a column MJD with double precision values but the schema declaration gives MJD a datatype FLOAT. When these tables were translated to parquet (via script) and ingested into PostgreSQL (partially manual procedure), FLOAT was translated to the equivalent 32-bit datatype, and so precision was lost in the translated values.

The simplest way to fix this is to regenerate the tables, using a corrected schema. In order to use the parquet script as is one would need to first fix the type declaration in the source sqlite file. This problem affects tables

JoanneBogart commented 3 years ago

This was fixed on or about May 4, 2021.