search

mysociety / parlparse

The scraper/parser that produces data for TheyWorkForYou, PublicWhip, etc
Other
61 stars 22 forks source link

`datadotparl/all-lords.xml` absent from `rawdata` #100

Closed samtazzyman closed 5 years ago

samtazzyman commented 5 years ago

I'm trying to run ./crawl-members from scripts/datadotparl as per the README and it's failing with the error

Traceback (most recent call last):
  File "./crawl-members", line 44, in <module>
    write(parl_members_url, members_fn)
  File "./crawl-members", line 31, in write
    open(fn, 'w').write(data)
IOError: [Errno 2] No such file or directory: '/parlparse/scripts/datadotparl/../../rawdata/datadotparl/all-lords.xml'
dracos commented 5 years ago

You need to create the output directory, it does not do it for you. In your case, from the above, that is parlparse/rawdata/datadotparl

dracos commented 5 years ago

PS The readme only really talks about that script, which is one, mostly not relevant, part of this repository's purpose; I don't think it's something other people really need to run, for example (I don't know what you're trying to do). If you're aware of that, that's fine, otherwise http://parser.theyworkforyou.com/ might be more useful (might not).