cytomining / cytominer-database

[DEPRECATED] A package for storing morphological profiling data.
Other
10 stars 10 forks source link

Integrate the use of a reference schema for the '--sqlite' option (done for `--parquet`) #127

Open diskontinuum opened 3 years ago

diskontinuum commented 3 years ago

Prevent column misalignment, NaN errors and other type incompatibilities also for --sqlite option, by: 1) determining a reference schema for the table columns 2) opening a writer 3) converting all subsequent files to that reference schema)

The functions are already deployed for the --parquet option (merged PR "Parquet_integration #122). This issue hence boils down to hooking existing functionality up for the 'sqlite' backend.

diskontinuum commented 3 years ago

See also the discussion in this pycytominer issue.