search

NCEAS / arctic-data-outreach

Outreach and engagement activities for the Arctic Data Center
Apache License 2.0
3 stars 4 forks source link

Organize the team drive #72

Open erinlynmclean opened 4 years ago

erinlynmclean commented 4 years ago
erinlynmclean commented 4 years ago

Thomas is working on this: Hi Erin, moving folders through the web interface is not possible (it was just a fluke that somehow worked for two folders), so I have been playing around with rclone on and off for the last week, mostly waiting for copies to finish. It is just in the middle of doing another backup which has been running for the last 5 1/2 hours and is maybe only halfway done. After that I will have to find all duplicates and rename or delete them on the original side and make sure original and backup are as identical as possible. The next two are currently unsolved challenges I have to talk to Matt and Nick about. How to lock the files or find a time when nobody is accessing them and do another, hopefully quick, sync. Locking is likely, generally, not possible for files owned by someone else. Deleting the originals

erinlynmclean commented 4 years ago

Update from Thomas:

Sorry, I put the migration to the side for a while as it does not seem possible to take ownership of somebody else’s files just for a specific folder which means there is no clean way to address 3. from above. I know we have to do it anyway. I will bring it up next week (Matt’s time is, of course, extra tight this month because of his jury duty).

erinlynmclean commented 4 years ago

Topic of discussion on July 10 Arctica call.

erinlynmclean commented 4 years ago

Update from Thomas:

'morning Erin, so we discussed this in our last meeting and Matt does not want us transferring files/folders half automated / half manually. He wants us to find a fully automated solution, so that we can apply it to all the WG directories that are currently being shared the same way as ADC. He mentioned that Dave Vieglais has a script to regularly sync D1 folders in two Google accounts. I am on vacation myself but will ask Dave about it when I am back in a couple of weeks. However, I am pretty sure that will not help us, as I understand it so far we cannot just move files or transfer ownership from accounts outside the NCEAS domain. Anyway, I will have to learn Python in order to understand Dave's script and then we all have to agree wether what we want do is possible and if not, if some type of automated copy will be enough. So, unfortunately, it will still be a while before we will move anything to a shared drive.

erinlynmclean commented 4 years ago

Will bring this up again in October!

mbjones commented 2 years ago

Still needs to be done, @nhchavez -- did you accidentally close this? It's kind of critical for our backups, but as Thomas outlined, there are issues in doing the transfer well and completely. Happy to discuss alternate approaches.

nhchavez commented 2 years ago

I closed it because it seemed like there hadn't been any movement on since August 2020 and I was trying to clean things up. I can reopen it, and some more context on this issue would be helpful