convert ec2 collection to make less db calls

[DavidPeleg6]

since dynamodb costs start to pile up, investigate other options such as moving to S3 as storage and saving dataframes in parquet. check whether you could get sql like access from it then

also lower the ec2 time to 2 hours