search

ZAdamMac / Tapestry

Specialist Batch File Backup Tool
GNU General Public License v3.0
3 stars 1 forks source link

[RFC] Add Native Support for Amazon S3 Glacier #24

Closed ZAdamMac closed 3 years ago

ZAdamMac commented 3 years ago

Is your feature request related to a problem? Please describe. Tapestry purports to create a storage-security agnostic backup, but offers limited (and frankly low-availability) options for cloud or remote storage of Tapestry's .tap backup files. This remote-to-the-user storage is a key part of a true recoverable backup solution and the fact it is missing is a potential risk exposure to users who are storing backup files purely locally.

Describe the solution you'd like In addition to the existing SFTP functionality, Tapestry should have a new network mode, 's3', which leverages the relatively low-cost Amazon S3 Glacier storage mechanism and allows for both automated backup and retrieval from a specified S3 bucket the user or organization controls. This would be provided alongside user-friendly tutorials on the setup and maintainance of S3 and allows us to leverage AWS's assurance regarding uptime and availability.

Describe alternatives you've considered Alternatives looked at were to create a guide on using various cloud platform vendors to allow the use of SFTP, which is already supported by Tapestry as a storage and retrieval mechanism.

Additional context This would be the first major feature release since SFTP support earlier in 2020.

ZAdamMac commented 3 years ago

After reviewing the documentation it looks like Amazon makes the API portion of this pretty straight forward. I'm inclined to adopt this enhancement for a early 2021release unless anyone sees a good reason why that should not be done.

This decision is only a little bit coloured by recent events.

ZAdamMac commented 3 years ago

Upon consideration it will be easier (and less subject to bloat/error) to retain only the SFTP network mode and instead implement a guide in the documentation for setting up SFTP in AWS, including the S3 Glacier storage method, similar to https://winscp.net/eng/docs/guide_amazon_s3_sftp#:~:text=To%20create%20a%20Managed%20SFTP,AWS%20role%20in%20IAM%20service.

The alternative would be to add functionality to tapestry that would have to be rather privileged in terms of the AWS environment, which isn't desired.

Closing issue.

ZAdamMac commented 3 years ago

A review of AWS Transfer and other access models for supporting SFTP to S3 has revealed that this is not cost effective for the stated audience of Tapestry, being "everyone", and certainly not me. As I will have to build a negotation for their API anyway, I will include that functionality as a Network mode of Tapestry in a 2.2 release.