I'm currently using the aws.s3 package in R to extract data from various CSV's in one of my AWS S3 buckets. The data is stored as seen below.
What I'm trying to do is extract ALL of the data currently in .csv format. So if I were just doing the first file there it would look as such:
data <- aws.s3::s3read_using(read.csv, object = "s3://test-testpilot/09242021-testpilot-michigan-script_results-09-24-2021-871107619.csv")
But the problem is, I want to extract all of the files and put them into three separate data frames. The first dataframe would be all the files that contain -script_results-. The second dataframe would be any file with just -results- in it, and the final dataframe would be any .csv file with -callers-.
What would be the most effective way to go about doing this?
I'm currently using the
aws.s3
package in R to extract data from various CSV's in one of my AWS S3 buckets. The data is stored as seen below.What I'm trying to do is extract ALL of the data currently in
.csv
format. So if I were just doing the first file there it would look as such:data <- aws.s3::s3read_using(read.csv, object = "s3://test-testpilot/09242021-testpilot-michigan-script_results-09-24-2021-871107619.csv")
But the problem is, I want to extract all of the files and put them into three separate data frames. The first dataframe would be all the files that contain
-script_results-
. The second dataframe would be any file with just-results-
in it, and the final dataframe would be any .csv file with-callers-
.What would be the most effective way to go about doing this?