Swiss-Polar-Institute / data-management-guidance

FIeld guide about data managment in the field for polar and high-altitude research. Also applicable to other parts of the world and any type of data / sample collection.
Other
0 stars 0 forks source link

Cloud storage #18

Closed cpina closed 4 years ago

cpina commented 4 years ago

The second point mentions "Physically stored" but I don't think that it's necessary (it's already mentioned in the first one)

The fourth point says "also for the number and size of copying data to and from the storage". I think that you meant "also for the number of files?". Or rephrase it a bit, it might be confusing now. Maybe mention that they also charge for operations like listing files (objects).

Perhaps add (here or somewhere) that the researcher will need to be familiar with other tools like rclone, check how to let other people to access to the bucket and different idiosyncrasies on the object storage compared with a file system. I enjoyed reading some weeks ago https://alexwlchan.net/2020/08/s3-prefixes-are-not-directories/ and https://alexwlchan.net/2020/08/s3-keys-are-not-file-paths/ - this is quite natural for me (but it's easy to forget and make mistakes around this!) but might not be obvious for some people when working on object storages.

I would change "moving the data impossible" to "moving the data very hard".

When you said "These would not normally be used..." I would add "it would normally be used for medium-long term storage or backups" (if this is what you meant)