Combining data CSVs

[cmmclaug]

4. Combining data CSVs rubric={correctness:10,reasoning:10}

• [x] Use one of the following options to combine data CSVs into a single CSV.

• Pandas

• DASK

• [x] When combining the csv files make sure to add extra column called "model" that identifies the model (tip : you can get this column populated from the file name eg: for file name "SAM0-UNICON_daily_rainfall_NSW.csv", the model name is SAM0-UNICON)

• [x] Compare run times and memory usages of these options on different machines within your team, and summarize your observations in your milestone notebook.

Warning: Some of you might not be able to do it on your laptop. It's fine if you're unable to do it. Just make sure you check memory usage and discuss the reasons why you might not have been able to run this on your laptop.

[KangboLu]

Needs more discussion after we all have the code finished running.