search

caopuzheng / 261-team-6-1-repo

261 team_6-1 repo
0 stars 0 forks source link

EXTRA CREDIT - Join dataset #3

Open caopuzheng opened 8 months ago

rachelgaoMIDS commented 8 months ago

EXTRA CREDIT: Join your own flights and weather tables (full join of all the data) and generate the dataset that will be used for training and evaluation.

Store on cold blob storage on overwrite mode [Use your Azure free credit (of $100) for storage only]

EDA on joined dataset that will be used for training and evaluation - Up to 15 points of Extra Credit (this is a though task, only try if you feel that you will complete it, priority should be the rest of the project) The Extra Credit can be claimed on any phase (2 or 3)

caopuzheng commented 7 months ago

for the 5Y join, it is expected to take about 1 day (using the cluster before additional resources)