Handle Large Socrata Tables - Githubissues

koopjs / koop-socrata

Socrata provider for Koop.

Other

8 stars 7 forks source link

Handle Large Socrata Tables #10

Closed pholleran closed 9 years ago

pholleran commented 9 years ago

Modfied Socrata.js to page through large datasets. Updated README.md.

Socrata provider will now:

Initiate initial request for 1,000 records and call koopCache.insert
Initiate subsequent requests if the initial request returns the full 1,000 records and call koopCache.insertPartial
Aggregate the GeoJSON through the paging process, returning a single, large GeoJSON file when complete

chelm commented 9 years ago

Cool, nice work.