GenSpectrum / LAPIS-SILO

Sequence Indexing engine for Large Order of genomic data
GNU Affero General Public License v3.0
12 stars 3 forks source link

ENH: Support incremental preprocessing #368

Open corneliusroemer opened 7 months ago

corneliusroemer commented 7 months ago

For the use case of processing large amounts of sequence data that are mostly changed only by addition of new sequences, it might be nice if preprocessing supported an incremental mode, that uses the previous processing result to speed up preprocessing.

I don't know the internals of what preprocessing does - but this could be very useful for use cases that want to do frequent updates with minimal delay.

Taepper commented 7 months ago

This is definitely on our TODO :)