search

HermannKroll / NarrativeIntelligence

GNU General Public License v3.0
3 stars 0 forks source link

Narrative Service: Low memory mode for inverse index is now broken #273

Closed HermannKroll closed 1 week ago

HermannKroll commented 3 months ago

The low memory mode for inverse index creation does not work anymore because gene ids need to be translated to symbols. In other words, we cannot sort the tag/predication table in advance as other gene ids may map to the same symbol which may lead into invalid indexes.

ir0ntr0nik commented 3 months ago

Applies only to Tag-table.

HermannKroll commented 2 months ago

We will optimize the index creation scripts by relying on the last db update date. Then we query all documents that are newer than this data und process them in the index creation.