search

askap-vast / vast-pipeline

This repository holds the code of the Radio Transient detection pipeline for the VAST project.
https://vast-survey.org/vast-pipeline/
MIT License
8 stars 3 forks source link

v2.0 Experiment: Add Django PostgreSQL copy support (3/4) #707

Open ajstewart opened 7 months ago

ajstewart commented 7 months ago

This is part of experimenting with new features for a potential v2.0

See this GIST: https://gist.github.com/ajstewart/9257bd3be3389d37058ab6bae5377904

This is PR 3/4

What is in this PR?

This PR adds the django-postgres-copy library and uses it to make all the uploads to the database, which can improve the speed dramatically.

Issue #383.