InformaticsMatters / squonk

Squonk platform and computational notebook
Apache License 2.0
8 stars 3 forks source link

Upgrade RDKit containers #126

Open tdudgeon opened 3 years ago

tdudgeon commented 3 years ago

All of the containers that run RDKit are quite dated, some back to 2017. These should be updated to 2020_03 based releases.

The problem here is that for the dockerised environment the main PostgreSQL database is a RDKit cartridge image (v9.4?) and cannot be simply upgraded to a recent version (the latest cartridge container images are based on PostgreSQL 11). A data export and import is likely to be needed.

The components affecting include:

tdudgeon commented 3 years ago

The above commit (on 126_rdkit_container_upgrades branch) updates the image definitions. Dockerised and K8S environments are updated. Hopefully it catches them all but it's possible there are some that have been missed.

The dockerised environment appears to run OK with these updates but as expected you cannot use an existing database as the data files are incompatible with the new postgres. Instead you have to start with an empty data dir where postgres stores its data.

In principle we should be able to fire up a new environment like this and then use pg_dump to export the old db contents and import that into the new db.

alanbchristie commented 3 years ago

Changes have been merged to the master branch and a test is underway