search

planningalerts-scrapers / issues

Only for keeping track of all issues related to scraping
0 stars 0 forks source link

Upper Hunter Shire Council #800

Closed mlandauer closed 1 year ago

mlandauer commented 1 year ago

This issue has been automatically created by PlanningAlerts. Only close this issue once the authority is working again on PlanningAlerts.

katska commented 1 year ago

Although it was labelled with probably fixed, something is still wrong. This authority is on the Masterview scraper, and is finding records but exiting, and the records are not appearing on Planning Alerts so far as I can tell.

Morph report:

History
Auto ran revision [2eac572d](https://github.com/planningalerts-scrapers/multiple_masterview/commit/2eac572d295020e4cb797a866335d9f3c8e8907f) and failed about 8 hours ago.
run time about 3 hours
**1508 records added, 1405 records removed in the database**

Not sure where the records are added because they don't show up on Planning Alerts (at least the few I spot checked).

Planning Alerts Upper Hunter reports 0 new applications scraped 06 Aug – 13 Aug 2023

These are the most recent DAs displayed at Recent applications within the last 2 months from Upper Hunter Shire Council, NSW page

202 Mayne St, Murrurundi 2338 NSW
4 days ago
Shed
21 Adelaide St, Murrurundi 2338 NSW
4 days ago
Carport
26 Park St, Scone 2337 NSW
4 days ago
Demolition of Existing Shed & Erect New Shed

The scraper failed with code 1.

The log for this scraper shows 62 records collected (start of output shown below) newer than the ones on Planning Alerts

Collecting feed data for upper_hunter...
Saving record 63/2023 - 1 - 68 Guernsey St, Scone 2337 NSW
Saving record 369/2005 - 2 - 60 Debenham St, Blandford 2338 NSW
Saving record 95/2023 - 1 - 8 Makybe Diva St, Scone 2337 NSW
Saving record 87/2023 - 1 - 211 Kelly St, Scone 2337 NSW

Upper Hunter website shows the applications from this week beginning with these, at least some of which cross over with the results found by the scraper (I didn't check the whole list).

Screenshot 2023-08-09 at 1 39 12 pm
mlandauer commented 1 year ago

It looks like there's only a few applications a week so I'm guessing there are times when there are few and the system thinks the scraper is broken? Anyway, it looks like new data is coming in. So, I'm going to close this.