loculus-project / loculus

An open-source software package to power microbial genomic databases
https://loculus.org
GNU Affero General Public License v3.0
37 stars 2 forks source link

Slow upload of many sequences #3093

Open chaoran-chen opened 3 weeks ago

chaoran-chen commented 3 weeks ago

I uploaded 50k dummy sequences (only NNN) with a very small metadata file (6 metadata fields) with a total of < 4 MB locally and it took minutes. That is quite slow, we should check how we are inserting data and what is causing this inefficiency.