rpasquini / twitter_and_displacement

Predictive analysis of gentrification and displacement on the basis of geo-tagged tweets based metrics.
2 stars 5 forks source link

Count tweets in each hex job (step 7) improvement #10

Open rpasquini opened 3 years ago

rpasquini commented 3 years ago

It eventually hangs in large dataset.
Solution to be implemented: Improve the code to handle smaller cursors. It should also be improved to insert many documents at a time (bulk write).

rpasquini commented 3 years ago

A new version is available that handles smaller cursors, preventing hanging. It stills needs to be tested with a large city.

Bulk write is pending.