Data combining, saving and quick EDA timing - Githubissues

UBC-MDS / 525_group10

MIT License

0 stars 0 forks source link

Data combining, saving and quick EDA timing #11

Closed dbandrews closed 3 years ago

dbandrews commented 3 years ago

Closes #4 , #5

Added in extracting CSV's from zip file to output folder.
Added in a function for combining all Australian rain csv's from a folder and extracting model names.
Notebook setup that can run all steps, albeit slowly. Shows comparisons of using Pandas/Dask for reading/writing files and Feather/parquet/csv