unitycatalog / unitycatalog

Open, Multi-modal Catalog for Data & AI
https://unitycatalog.io/
Apache License 2.0
1.88k stars 258 forks source link

Remove AWS SDK v1 (upgrade existing code to v2) #124

Open alexreid-db opened 6 days ago

alexreid-db commented 6 days ago

There is some code which relies on / uses the aws sdk v1. We should update that to use the aws sdk v2 and remove that dependency. In FileUtils.java, there is some code that writes/deletes to s3 which should be update to v2 api.

tdas commented 3 days ago

@alexreid-db could you elaborate on (1) the reasons, (2) which specific code to update? With a bit more guidance, this can be marked as a "good first issue"