search

opencivicdata / python-legistar-scraper

Scrapes municipal data from Legistar websites
BSD 3-Clause "New" or "Revised" License
42 stars 28 forks source link

Scrape private #81

Closed reginafcompton closed 5 years ago

reginafcompton commented 5 years ago

This PR enables scraping private bills.

It works in cooperation with the changes in https://github.com/opencivicdata/scrapers-us-municipal/pull/258.

fgregg commented 5 years ago

@reginafcompton can you refresh me on what's changing here with our data access. From looking at the code it seems like we already had access to private events in the API, and that is kind of what the problem was?

reginafcompton commented 5 years ago

@fgregg the Metro folks sent us an API token, which gives us access to everything in the API, including Bills with restricted views.

To make use of the token, I borrowed the ingenuity from NYC and created a secrets file with that token (it will be an encrypted file on the DataMade server): https://github.com/opencivicdata/scrapers-us-municipal/pull/258/files#diff-e3866abdbe598ba387e059bc654df79fR12