remove dependency on `boto3`

sbrudenell / btrfs2s3

maintains a tree of differential backups in object storage

MIT License

36 stars 1 forks source link

remove dependency on `boto3` #77

Open sbrudenell opened 2 months ago

sbrudenell commented 2 months ago

boto3 and family are bloated
I'm not even sure what our implementation is currently doing (are we passing checksum trailers due to uploading a non-seekable stream? should we?)
botocore is many MB of API model data we don't even use
our interaction with S3 APIs is not complex
our interaction with S3 APIs is treated as a core feature, we should have direct control over it

sbrudenell commented 2 months ago

type safety with the boto3 family is a development burden

sbrudenell commented 2 months ago

while I don't mind reimplemting the core S3 functionality, boto3 has a lot of different options for authentication. I'm not sure I want to reimplement every case of sts-mediated access, especially when new authentication schemes are created.