Using Dask Datafame in Geopandas call

aionthebeach / ocean-maps

This repository is about Global Fish Watch(GFW) Analysis using GFW dataset.

8 stars 4 forks source link

Using Dask Datafame in Geopandas call #25

Closed prafulfillment closed 4 years ago

prafulfillment commented 4 years ago

Notebook at code cell 21 is not using Dask Dataframe and instead forces a conversion into a massive pandas data frame which causes the notebook to crash

More information:

https://towardsdatascience.com/geospatial-operations-at-scale-with-dask-and-geopandas-4d92d00eb7e8
https://github.com/r-shekhar/NYC-transport/blob/master/05_raw_to_dataframe/convert_bike_csv_to_parquet.py

prafulfillment commented 4 years ago

Figured it out. We're using h3 to determine joins using intersections