search

Chicago / RSocrata

Provides easier interaction with Socrata open data portals http://dev.socrata.com. Users can provide a 'Socrata' data set resource URL, or a 'Socrata' Open Data API (SoDA) web query, or a 'Socrata' "human-friendly" URL, returns an R data frame. Converts dates to 'POSIX' format. Manages throttling by 'Socrata'.
https://CRAN.R-project.org/package=RSocrata
Other
237 stars 83 forks source link

Increase Paging Capacity #129

Closed nicklucius closed 7 years ago

nicklucius commented 7 years ago

The Socrata API returns 1000 rows at a time by default, and RSocrata currently leaves the default in place. Increasing it to return 50,000 rows will allow for faster paging through large datasets.

https://dev.socrata.com/docs/paging.html

nicklucius commented 7 years ago

I can't think of a way to write a test for this. The paging is done implicitly inside read.socrata() and no information about it is returned by the function.

tomschenkjr commented 7 years ago

Yeah, can't think of one either. Perhaps the most important thing is not breaking the other tests.

_ Tom Schenk Jr. Chief Data Officer Department of Innovation and Technology City of Chicago (312) 744-2770 tom.schenk@cityofchicago.org | @ChicagoCDO data.cityofchicago.org | opengrid.io | digital.cityofchicago.org | chicago.github.io | dev.cityofchicago.org

On Wed, Mar 8, 2017 at 7:56 AM -0600, "Nick Lucius" notifications@github.com<mailto:notifications@github.com> wrote:

I can't think of a way to write a test for this. The paging is done implicitly inside read.socrata() and no information about it is returned by the function.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/Chicago/RSocrata/issues/129#issuecomment-285046573, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ABkC0Zv8hhziNyyDNuRzuWyxmXae3rvZks5rjrOBgaJpZM4MWzbK.

This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.