WhiteHouse / petitions

Drupal installation profile powering We The People at petitions.whitehouse.gov
https://petitions.whitehouse.gov/
1.14k stars 336 forks source link

Export petition data? #44

Open markratledge opened 12 years ago

markratledge commented 12 years ago

I don't use Drupal and haven't used this module, and this may be more of a MongoDB issue or feature, but I see a need to be able to export the petition data - name, city, state, date and signature # - to a CSV file or other export format.

Is there already a feature within the Drupal module for this? Is this a possible feature for a future version? Once the module uses MySQL?

Right now, I'd like to be able to download datasets from some of the current petitions for research. Yes, as data sets, the petitions have problems in sampling, anonymity, verification of users, etc. But still, it would be nice to export or download the data of a petition.

binaryechoes commented 12 years ago

Just curious, are you specifically interested in White House petition data or petition data used by this module?

On Sun, Nov 25, 2012 at 9:54 PM, markratledge notifications@github.comwrote:

I don't use Drupal and haven't used this module, and this may be more of a MongoDB issue or feature, but I see a need to be able to export the petition data - name, city, state, date and signature # - to a CSV file or other export format.

Is there already a feature within the Drupal module for this? Is this a possible feature for a future version? Once the module uses MySQL?

Right now, I'd like to be able to download datasets from some of the current petitions for research. Yes, as data sets, the petitions have problems in sampling, anonymity, verification of users, etc. But still, it would be nice to export or download the data of a petition.

— Reply to this email directly or view it on GitHubhttps://github.com/WhiteHouse/petition/issues/44.

welschp commented 12 years ago

Thanks for writing, @markratledge. We're in the process of developing an API that will allow read-only access to the We the People dataset. While we don't have a release date scheduled yet, that functionality will also be added to the petitions project on GitHub once it is complete.

AldenJole commented 12 years ago

This person votes for naming the data set something more descriptive and less symbolic.

markratledge commented 12 years ago

@welschp and @binaryechoes, Thanks for the response, and yes, an API would be useful for people who use the module on their own systems. But I'm interested in the current data right now at petitions.whitehouse.gov.

binaryechoes commented 12 years ago

No problem Mark. Send me an email (available on my profile) and I should be able to help you out.

On Tue, Nov 27, 2012 at 9:18 AM, markratledge notifications@github.comwrote:

@welschp https://github.com/welschp and @binaryechoeshttps://github.com/binaryechoes, Thanks for the response, and yes, an API would be useful for people who use the module on their own systems. But I'm interested in the current data right now at petitions.whitehouse.gov.

— Reply to this email directly or view it on GitHubhttps://github.com/WhiteHouse/petition/issues/44#issuecomment-10759324.

thedod commented 11 years ago

Just a thought: Why not have all sigs also stored on a publicly-readable couchdb or something? Then can people can do client-side visualisations. See proof-of-concept at http://bl.ocks.org/4548858

All it takes is a single https POST per signature.