search

NCEAS / metacat

Data repository software that helps researchers preserve, share, and discover data
https://knb.ecoinformatics.org/software/metacat
GNU General Public License v2.0
27 stars 13 forks source link

Move GOA to K8s #1996

Open artntek opened 2 hours ago

artntek commented 2 hours ago

Tracking progress for moving goa.nceas.ucsb.edu to k8s prod cluster

artntek commented 2 hours ago

Initial rsync

brooke@mn-ucsb-2:~/.ssh$ time rsync -aHAX /var/goa/ brooke@arctica.nceas.ucsb.edu:/mnt/pdg/repos/goa/metacat/
rsync: [generator] chgrp "/mnt/pdg/repos/goa/metacat/." failed: Operation not permitted (1)

rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2019-22": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2019-23": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2019-25": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2019-29": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2019-35": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2019-42": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2019-46": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2019-48": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2019-51": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2020-03": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2020-06": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2020-07": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2020-13": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2020-22": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/logs/metacatreplication.log.2020-27": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/solr-last-proccessed-date": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_enyl.fdt": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_enyl.fdx": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_enyl.fnm": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_enyl.frq": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_enyl.nrm": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_enyl.prx": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_enyl.tii": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_enyl.tis": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_enyl_dp.del": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fua2.fdt": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fua2.fdx": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fua2.fnm": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fua2.frq": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fua2.nrm": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fua2.prx": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fua2.tii": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fua2.tis": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fua2_1t.del": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fusn.fdt": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fusn.fdx": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fusn.fnm": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fusn.frq": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fusn.nrm": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fusn.prx": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fusn.tii": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fusn.tis": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fusn_1.del": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fuso.fdt": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fuso.fdx": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fuso.fnm": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fuso.frq": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fuso.nrm": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fuso.prx": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fuso.tii": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/_fuso.tis": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/segments.gen": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home-old/data/index/segments_gzi1": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/solr-home2/solr-last-proccessed-date": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002946.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002947.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002948.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002949.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002950.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002951.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002952.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002953.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002954.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002955.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002956.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002957.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002958.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002959.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002960.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002961.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002962.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002963.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002964.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002965.tmp": Permission denied (13)
rsync: [sender] send_files failed to open "/var/goa/temporary/upload__7991a9df_16ea4edd1f0__8000_00002966.tmp": Permission denied (13)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1338) [sender=3.2.7]

real    5m18.979s
user    1m34.476s
sys 1m36.592s
brooke@mn-ucsb-2:~/.ssh$

For now, assuming we do not need to transfer any of the following:

/var/goa/solr-home-old*
/var/goa/solr-home2*
/var/goa/temporary/*

I will transfer:

/var/goa/logs/metacatreplication.log*