search

planningalerts-scrapers / issues

Only for keeping track of all issues related to scraping
0 stars 0 forks source link

Gunnedah Shire Council #958

Open mlandauer opened 3 months ago

mlandauer commented 3 months ago

This issue has been automatically created by PlanningAlerts. Only close this issue once the authority is working again on PlanningAlerts.

katska commented 2 months ago

No longer Masterview - the existing link times out (even with https)

They're on the NSW Planning Portal, link from council website goes to

https://www.planningportal.nsw.gov.au/daexhibitions?field_daex_status_value=All&field_local_government_area_value=GUNNEDAH&field_application_type_value=All&field_panel_reference_number_value=&field_council_unique_number_value=&title=&field_exhibition_start_date_value=&field_exhibition_end_date_value= Specifically those on exhibition https://www.planningportal.nsw.gov.au/daexhibitions?field_daex_status_value=On+Exhibition&field_local_government_area_value=GUNNEDAH&field_application_type_value=Development+Application&field_panel_reference_number_value=&field_council_unique_number_value=&title=&field_exhibition_start_date_value=&field_exhibition_end_date_value=

mlandauer commented 2 months ago

Had another look at the "public" API for NSW planning portal and it still doesn't contain anything that looks like a description but @katska as you pointed out (in Slack I think) the web pages for the planning portal do contain something like a description - it looks pretty mangled in some cases (address, DA, title all mixed up and varies by council) but at least there's something.

So, it might be worth having a go at writing an old fashioned scraper for the NSW planning portal. Unbelievable that this is still necessary after all this time and money spent by NSW on the planning portal.