planningalerts-scrapers / issues

Only for keeping track of all issues related to scraping
0 stars 0 forks source link

Development Assessment Panels #77

Open mlandauer opened 4 years ago

mlandauer commented 4 years ago

This issue has been automatically created by PlanningAlerts for Development Assessment Panels

It uses the scraper planningalerts-scrapers/development_assessment_panel_applications

Only close this issue once the authority is working again on PlanningAlerts. Otherwise a new issue will just automatically created. Also, if there is a duplicate issue close the other one in favour of this one.

CloCkWeRX commented 4 years ago

From looking around, it seems they no longer publish this info in PDF form.

https://espatial.dplh.wa.gov.au/planwa/Index.html?viewer=planwa&layerTheme=Applications

mlandauer commented 3 years ago

Found a PDF with the current development assessment panel applications linked to from https://www.dplh.wa.gov.au/about/development-assessment-panels/current-dap-applications-and-information

mlandauer commented 3 years ago

The PDF seems to mostly have addresses with just lot numbers so that looks pretty useless. Might be worth trying to see if the ESRI app that @CloCkWeRX mentioned above has an open API. ESRI, the application does but we need to find out if they open it for this particular case.

mlandauer commented 3 years ago

For the time being I'm just going to comment out the scraper so that it doesn't error at least (to try to reduce noise)

twcau commented 1 year ago

There is now a PDF, and a new permanent home for this information:

info_url: https://www.wa.gov.au/government/document-collections/current-development-assessment-panel-applications-and-information

url: https://www.wa.gov.au/system/files/YYYY-MM/current-dap-applications.pdf

YYYY: Four digit current year MM: Two digit current month

I don’t have the skills to even consider updating the scraper, but would be good to see WA DAP data back in PlanningAlerts.

katska commented 1 month ago

@mlandauer PDF scrapers out there now? :/ does this look doable?