Fixes problems with starting the cronjob pod, the entrypoint was calling sync.py from the wrong location (current workdir instead of root).
Also includes performance improvements that dramatically reduce the running time of the job from 24h to 10m - namely by using bulk insert/update calls rather than individual db calls per row of data.
Fixes problems with starting the cronjob pod, the entrypoint was calling sync.py from the wrong location (current workdir instead of root).
Also includes performance improvements that dramatically reduce the running time of the job from 24h to 10m - namely by using bulk insert/update calls rather than individual db calls per row of data.
Some basic unit tests were also added.