search

matthiaskoenig / pkdb

Pharmacokinetics database
https://alpha.pk-db.com
30 stars 7 forks source link

Improve upload speed of upload_nodes #543

Closed janekg89 closed 4 years ago

matthiaskoenig commented 4 years ago

@janekg89 Provide more specific descriptions for issue. Currently, it takes very long to upload the info_nodes in the database. This is mainly due to individual upload of every node. Via batch upload the upload speed can be improved.

janekg89 commented 4 years ago

The upload speed of the info nodes improved by ~2.5. This is still not a true bulk create (multiple database calls but only 1 rest request). The loop is now on the server-side. 

(pkdb_data) janek@dell-desktop:~/Dev/pkdb_data$ upload_nodes
> INFO upload info nodes: http://0.0.0.0:8000
> INFO - 78.13 [s] : Upload info_nodes (old)
> INFO - 31.41 [s] : Upload info_nodes