Change paths in download script + parsing proposal description in html

transparentdemocracy / voting-data

Voting behavior data extracted from plenary reports of the Belgian federal government.

5 stars 1 forks source link

Change paths in download script + parsing proposal description in html #12

Closed karel1980 closed 2 months ago

karel1980 commented 2 months ago

Scripts were updated to expect data/input/pdf and data/input/html but download script wasn't changed.

Extracting proposal description would make html parsing feature complete and theoretically allow to replaced and remove PDF parsing next

karel1980 commented 2 months ago

Note: code is still 💩 but at least the tests pass (unless recent plenaries were added to dekamer.be, then there will be >300 plenaries) - we could check if the number of plenaries === number of files instead.

sandervh14 commented 2 months ago

Hey @karel1980, thanks! I will review your work tomorrow. :-) I see we started working in parallel. Don't worry, I'll merge my work onto yours.