unipept / unipept-database

Makes database tables and indices for Unipept
MIT License
0 stars 2 forks source link

Add sort_peptides back temporarily #51

Closed stijndcl closed 6 months ago

stijndcl commented 6 months ago

After 6 weeks of trying to import the MariaDB database I discovered that the peptides not being sorted is the culprit.

This does not make any impact for Postgres, but apparently it makes a massive impact for MariaDB.

Hence, I've added the old sort_peptides step back in. Added some TODO comments so we can find it again in the near future when we switch to PSQL.

bmesuere commented 6 months ago

Ah, yes, this makes sense. In innodb, tables/indexes are stored in a sorted order. Inserting in non-sorted order will cause rewrites.