Use integer columns in comparison

gyorilab / indra_db

A Database-based knowledge back-end built on and for INDRA. The INDRA Database is a service that can be set up by any user with their own content and knowledge access. Our implementation of the database is the back-end to many of our projects, providing a vast and detailed knowledge base derived from many resources.

GNU General Public License v3.0

16 stars 10 forks source link

Use integer columns in comparison #215

Closed kkaris closed 1 year ago

kkaris commented 2 years ago

This PR updates the helper method _get_existing in indra_db/copy_utils.py to use the _num columns of the text_ref table instead of the string version of the same. This speeds up the query for the text_ref use case 3600-7200 times.

~Todo before this PR is ready for review:~ ~Check that the update doesn't break the other daily update scripts (not expected).~

kkaris commented 1 year ago

With all the scripts having been verified to work, I think we can think about merging this now