Closed derekeder closed 10 months ago
taking some notes here:
the body doing the action is often wrong:
https://chicityclerkelms.chicago.gov/Matter/?matterId=6FBDB317-5C09-EE11-8F6D-001DD809B965 https://chicityclerkelms.chicago.gov/Matter/?matterId=359F7376-F509-EE11-8F6D-001DD809B965
(related matters is also broken on that one)
https://chicityclerkelms.chicago.gov/Matter/?matterId=90303FC2-000A-EE11-8F6D-001DD809B578 https://chicityclerkelms.chicago.gov/Matter/?matterId=A5F30658-E30A-EE11-8F6D-001DD809B965
...
It appears that title
field in the Matters is not a filterable field.
This is useful to me because I only want to extract matters pertaining to certain categories, i.e. "zoning reclassification" for zoning map amendments (rezonings).
It would also be nice if matterCategory
was a filterable field, since the Clerk appears to use "matterCategory": "ZONING RECLASSIFICATIONS"
consistently.
For my purposes, however, using the full-text search and quoting "zoning reclassification" should capture at least this category of matters. (City Council is consistent in using that phrase in the title for rezonings, but City Council is not consistent for a lot of other categories that I try to scrape.)
curl -X GET "https://api.chicityclerkelms.chicago.gov/matter?search=%22zoning%20reclassification%22" -H "accept: application/json; charset=utf-8"
around 700 bills have an action where the org name is missing. missing_action_org.txt
https://api.chicityclerkelms.chicago.gov/matter/recordNumber=
endpoint sometimes need a whitespace character after the record number, and sometimes not.
https://api.chicityclerkelms.chicago.gov/matter/recordNumber/SO2023-0002817
doesn't work but
https://api.chicityclerkelms.chicago.gov/matter/recordNumber/SO2023-0002817%20
does
the new system has cases where there are multiple distinct entries for the same bill
https://chicityclerkelms.chicago.gov/Matter/?matterId=60659CA3-1F11-EE11-8F6C-001DD8094692 https://chicityclerkelms.chicago.gov/Matter/?matterId=27585215-4305-EE11-8F6D-001DD806EC60
https://chicityclerkelms.chicago.gov/Matter/?matterId=78E9D319-4D14-EE11-8F6D-001DD806F88B https://chicityclerkelms.chicago.gov/Matter/?matterId=D47CEE41-4E14-EE11-8F6D-001DD806F9D9
@fgregg we've been switched over for a while now. should we close and track data problems in separate issues?
https://notes.chicago.councilmatic.org/blog/using-data-from-new-system.html
sure!
On Fri, Oct 20, 2023 at 4:57 PM Derek Eder @.***> wrote:
@fgregg https://github.com/fgregg we've been switched over for a while now. should we close and track data problems in separate issues?
https://notes.chicago.councilmatic.org/blog/using-data-from-new-system.html
— Reply to this email directly, view it on GitHub https://github.com/datamade/chi-councilmatic/issues/352#issuecomment-1773385046, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEDC3PCNMIPXFBW2TC4UVDYALQVHAVCNFSM6AAAAAAZJUIIQOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONZTGM4DKMBUGY . You are receiving this because you were mentioned.Message ID: @.***>
The Chicago City Clerk is launching a new legislative management system to replace Legistar: https://chicityclerkelms.chicago.gov/
Some time later today (June 16), the chicago.legistar.com/ will no longer work and we will need to update our scrapers to pull data from the new API. Documentation is here: https://api.chicityclerkelms.chicago.gov/
I've been told the new system will have all the same data as the old one. As of this writing, data is updated through June 2, 2023.