skyplane-project / skyplane

🔥 Blazing fast bulk data transfers between any cloud 🔥
https://skyplane.org
Apache License 2.0
1k stars 58 forks source link

Update tests for bucket cleanup + remove unnecessary installs #865

Closed abiswal2001 closed 1 year ago

abiswal2001 commented 1 year ago

S3 currently does not have proper bucket cleanup after testing leading to TooManyBuckets errors on tests after a certain point. This adds the cleanup logic to every integration test.

Furthermore, the hadoop jdk installs were removed as they should not be required anymore.