mysociety / parlparse

The scraper/parser that produces data for TheyWorkForYou, PublicWhip, etc
Other
61 stars 22 forks source link

Written questions/statements, and table fixes #131

Closed dracos closed 4 years ago

dracos commented 4 years ago

Parliament launched a whole new site at https://questions-statements.parliament.uk/ - this updates the code to fetch data from there. They do have an API but this morning it was over a day behind the site. This appears to be okay now, but we don't know whether the API is maintained as well as the site, so we shall stick with fetching directly from the site for now (one downside is the API does tell you if questions are grouped which the website does not any more, but that's not major).

Also fix an issue whereby we weren't parsing tables in Hansard - spotting the table but then ignoring all its rows.