search

AuDigitalHealth / sctau-sample-scripts

Sample relational database load scripts and SQL queries for processing SNOMED CT-AU RF2 release files.
Other
13 stars 4 forks source link

SQLite support? #2

Open zanchey opened 3 years ago

zanchey commented 3 years ago

I've found these scripts useful in exploring the snapshot data, but having lost too many hours of my life to restoring MySQL databases with vi and a toothpick, I translated them to SQLite instead. After several hours of runtime (mostly thanks to the v3_AMT_products table), this produces a ~2.1 GB file which produces extremely rapid local queries as the whole thing can be loaded into memory on any reasonably modern machine.

Would you take a pull request to include these scripts as well? I can reorganise the repository into MySQL and SQLite directories, or just add the SQLite directory as is.

caitlin-f commented 3 years ago

I've found these scripts useful in exploring the snapshot data, but having lost too many hours of my life to restoring MySQL databases with vi and a toothpick, I translated them to SQLite instead. After several hours of runtime (mostly thanks to the v3_AMT_products table), this produces a ~2.1 GB file which produces extremely rapid local queries as the whole thing can be loaded into memory on any reasonably modern machine.

Would you take a pull request to include these scripts as well? I can reorganise the repository into MySQL and SQLite directories, or just add the SQLite directory as is.

Access to those SQLite scripts would be very useful

zanchey commented 3 years ago

Hi Caitlin, you can find them in my fork at https://github.com/zanchey/sctau-sample-scripts