Upload and register flat files into Athena enhancement

DyfanJones / noctua

Connect R to Athena using paws SDK (DBI Interface)

https://dyfanjones.github.io/noctua/

Other

45 stars 5 forks source link

Upload and register flat files into Athena enhancement #37

Open DyfanJones opened 4 years ago

DyfanJones commented 4 years ago

The development of this will be covered by RAthena ticket: #25

DyfanJones commented 4 years ago

A few key differences to consider. The SDK paws package doesn't support upload_file function like boto3, this means the flat files will have to be first read into R and then uploaded. This can mean that reader functions for example from readr could be supported by added a parameter FUN. This means the user could possibly use their own reader function to read in the file before uploading it to AWS Athena.