search

mysociety / theyworkforyou

Keeping tabs on the UK's parliaments and assemblies
http://www.theyworkforyou.com/
Other
226 stars 52 forks source link

Update parser documentation #1613

Open RichardTaylor opened 2 years ago

RichardTaylor commented 2 years ago

The documentation at

https://parser.theyworkforyou.com/parser.html

is out of date.

Ticket noted in light of correspondence asking how TWFY currently obtains information and the related https://github.com/mysociety/parlparse/issues/160 which indicates the documentation is out of date.

RichardTaylor commented 2 years ago

Some related text:

The prime current source of Parliamentary data is the .zip files obtained via

https://github.com/mysociety/parlparse/blob/master/pyscraper/unpack_hansard_zips.py

As you can see from that we use the feed at

http://api.data.parliament.uk/resources/files/feed?dataset=12

That feed doesn't cover Written Questions or Statements which we get from:

https://writtenquestions-api.parliament.uk/index.html

Depending on what you are seeking to do you might find the structured
data made available via

https://www.theyworkforyou.com/api/

or

http://parser.theyworkforyou.com/hansard.html

of use.

If you are considering working with data from Parliament directly you might want to check with Parliament what data sources they are formally offering, and planning to maintain. The main feed we use does not appear to be publicly listed at the moment. We don't know why that is.

See:

https://explore.data.parliament.uk/

and

https://developer.parliament.uk/