malariagen / fits

File tracking system for group DK
0 stars 0 forks source link

Separating "notes" into a table, and use adapted code #57

Closed magnusmanske closed 5 years ago

magnusmanske commented 5 years ago

For proper logging (see #56), more tables should have a "note" field. Notes, as plain-text strings, are highly repetitive ("imported from MLWH on xxx"), and use up a lot of DB storage (which also tends to slow down DB systems). Additionally, notes should be more machine-readable than a plain-text string.

I am currently testing/converting an altered SQL schema in FITS (production) that has a new table note, with source, rationale, and day field. Tables with (meta-)data get an additional "note_id" field (default:null).

I am also altering relevant views to show both the note field, and the additional information from the note table, where available.

I am also converting some notes into the new format, to test the system.

I am also preparing C++ code in a new branch to support this.

magnusmanske commented 5 years ago

The code, as well as the full SQL required to seed the database, is now in branch note_reorganisation.

magnusmanske commented 5 years ago

This is now done per PR.