skyplane-project / skyplane

🔥 Blazing fast bulk data transfers between any cloud 🔥
https://skyplane.org
Apache License 2.0
1k stars 58 forks source link

Delete test buckets during integration testing #798

Closed parasj closed 1 year ago

parasj commented 1 year ago

Fixes #797

parasj commented 1 year ago

@sarahwooders I'll have to merge to test this to ensure it works, but this is the output on my local machine:

[cloudshell-user@ip-10-4-5-245 ~]$           for pattern in "test-skyplane-" "skyplane-integration-us-east-1-" "integrationus-east-1-"; do
>             aws s3api list-buckets --query "Buckets[?starts_with(Name, \`${pattern}\`) == \`true\`].Name" --output text | tr '\t' '\n' | while read bucket; do aws s3 rb "s3://$bucket" --force; done
>           done
delete: s3://skyplane-integration-us-east-1-11686308/dest_35acd7bb-00fc-4f74-8154-ce50c0a7c1e2/0
remove_bucket: skyplane-integration-us-east-1-11686308
delete: s3://skyplane-integration-us-east-1-14b45e67/dest_2d13b329-f6e7-4309-825c-6852e98bcaaa/0
remove_bucket: skyplane-integration-us-east-1-14b45e67
remove_bucket: skyplane-integration-us-east-1-15d1b487
delete: s3://skyplane-integration-us-east-1-1cfec5f4/dest_d0401657-9900-4a7f-a05d-9e871d3ce7ce/0
remove_bucket: skyplane-integration-us-east-1-1cfec5f4
delete: s3://skyplane-integration-us-east-1-283fa797/dest_2edda517-2bb5-4e19-af4d-16e75f50a4f7/0
remove_bucket: skyplane-integration-us-east-1-283fa797
delete: s3://skyplane-integration-us-east-1-539f9c40/dest_ce0d5a9f-7ab5-4fe5-bf1d-a02bc6659bf5/0
remove_bucket: skyplane-integration-us-east-1-539f9c40
delete: s3://skyplane-integration-us-east-1-6031bbc0/dest_d302558c-693a-4558-94bb-fefd1c0ffdda/0
remove_bucket: skyplane-integration-us-east-1-6031bbc0
delete: s3://skyplane-integration-us-east-1-617efdbd/dest_eae17fc6-b3eb-47cf-8810-f65fb1ef0880/0
remove_bucket: skyplane-integration-us-east-1-617efdbd
delete: s3://skyplane-integration-us-east-1-957c8643/dest_c114ae56-b781-47dc-826c-a76967e837bb/0
remove_bucket: skyplane-integration-us-east-1-957c8643
delete: s3://skyplane-integration-us-east-1-ad2c1492/dest_2e7e799c-bdc6-41a9-a075-abe4a6579fb4/0
remove_bucket: skyplane-integration-us-east-1-ad2c1492
delete: s3://skyplane-integration-us-east-1-b2a23a15/dest_5dec1b4f-47cd-4d0a-baa7-85336580784d/0
remove_bucket: skyplane-integration-us-east-1-b2a23a15
delete: s3://skyplane-integration-us-east-1-df7d3aee/dest_0c26b1af-4439-43e9-b0c5-0aac36cee81c/0
remove_bucket: skyplane-integration-us-east-1-df7d3aee
delete: s3://integrationus-east-1-2d798cd2/src_f834e56f-119e-4726-9bd1-7ce9c160182d/0
remove_bucket: integrationus-east-1-2d798cd2
delete: s3://integrationus-east-1-38c3ac1d/src_9d676206-3346-460c-a2a0-477063bb452c/0
remove_bucket: integrationus-east-1-38c3ac1d
delete: s3://integrationus-east-1-58cf8fa5/src_98f71e68-58d3-49ac-ae63-ffe6e1a6c9d0/0
remove_bucket: integrationus-east-1-58cf8fa5
delete: s3://integrationus-east-1-6a6a08f5/src_6d39c9ac-471f-4aa8-b521-ad29f47be9ce/0
remove_bucket: integrationus-east-1-6a6a08f5
delete: s3://integrationus-east-1-7519e447/src_9d3798df-a7c1-4db2-9771-107ed5985cfc/0
remove_bucket: integrationus-east-1-7519e447
delete: s3://integrationus-east-1-87c44ca9/src_1a7a4ed2-211b-4656-aac6-50abdeefe0ba/0
remove_bucket: integrationus-east-1-87c44ca9
delete: s3://integrationus-east-1-96bb4af0/src_00f870e9-1047-4c5a-89ad-ae76d1d8e7f8/0
remove_bucket: integrationus-east-1-96bb4af0
delete: s3://integrationus-east-1-d6dc23ee/src_8d9947a3-890d-4b28-a4e4-145c150ba29e/0
remove_bucket: integrationus-east-1-d6dc23ee
delete: s3://integrationus-east-1-db67ecb9/src_d86efcb9-c306-40e8-b595-5251df4f3b15/0
remove_bucket: integrationus-east-1-db67ecb9
delete: s3://integrationus-east-1-dc06ee48/src_0eb45449-df12-459e-9b6b-b4ac39752701/0
remove_bucket: integrationus-east-1-dc06ee48
delete: s3://integrationus-east-1-df4bf382/src_52d0e923-7a04-44e8-bbbd-a1c00e3cc499/0
remove_bucket: integrationus-east-1-df4bf382
delete: s3://integrationus-east-1-f46b50c9/src_4363cbd0-a0d6-4264-86bb-928d40d2aa76/0
remove_bucket: integrationus-east-1-f46b50c9